[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:41:56 dist-test-slave-45dx krb5kdc[21974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:41:56 dist-test-slave-45dx krb5kdc[21974](info): set up 2 sockets
Aug 12 16:41:56 dist-test-slave-45dx krb5kdc[21974](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 16:41:57.944155 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:41:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:41:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:41:58.069536 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:41287
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:41287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:41:58.152525 22001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:41:58.152724 22001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:41:58.152745 22001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:41:58.153851 22001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:41:58.153888 22001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:41:58.153903 22001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:41:58.153915 22001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:41:58.153927 22001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:41:58.155357 22001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:41287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:41287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:41:58.155547 22001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:41:58.155741 22001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:41:58.161038 22018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:41:58.161029 22013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.161058 22001 server_base.cc:1034] running on GCE node
W20260812 16:41:58.161029 22021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.161563 22001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:41:58.161919 22001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:41:58.163115 22001 hybrid_clock.cc:648] HybridClock initialized: now 1786552918163095 us; error 51 us; skew 500 ppm
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:41:58.172569 22001 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:41:58.173096 22001 webserver.cc:460] Webserver started at http://127.21.114.126:39871/ using document root <none> and password file <none>
I20260812 16:41:58.173348 22001 fs_manager.cc:359] Metadata directory not provided
I20260812 16:41:58.173415 22001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:41:58.173560 22001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:41:58.174647 22001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "e7923fcac3bf425080e36a4365665b77"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "117342eac6da53a73871d4dfa54f81ab"
server_key_iv: "ef8c3be654c1992d346e9d4ed6fff08a"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.175033 22001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "e7923fcac3bf425080e36a4365665b77"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "117342eac6da53a73871d4dfa54f81ab"
server_key_iv: "ef8c3be654c1992d346e9d4ed6fff08a"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.176430 22001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:41:58.177223 22039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.177430 22001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:41:58.177544 22001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "e7923fcac3bf425080e36a4365665b77"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "117342eac6da53a73871d4dfa54f81ab"
server_key_iv: "ef8c3be654c1992d346e9d4ed6fff08a"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.177624 22001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:41:58.190099 22001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:41:58.192529 22001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:41:58.192698 22001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:41:58.196864 22001 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:41287
I20260812 16:41:58.196902 22132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:41287 every 8 connection(s)
I20260812 16:41:58.197335 22001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:41:58.198347 22137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:41:58.200744 22137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77: Bootstrap starting.
I20260812 16:41:58.201359 22137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77: Neither blocks nor log segments found. Creating new log.
I20260812 16:41:58.201658 22137 log.cc:824] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77: Log is configured to *not* fsync() on all Append() calls
I20260812 16:41:58.202373 22137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77: No bootstrap required, opened a new log
I20260812 16:41:58.203981 22137 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7923fcac3bf425080e36a4365665b77" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41287 } }
I20260812 16:41:58.204124 22137 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:41:58.204146 22137 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7923fcac3bf425080e36a4365665b77, State: Initialized, Role: FOLLOWER
I20260812 16:41:58.204350 22137 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7923fcac3bf425080e36a4365665b77" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41287 } }
I20260812 16:41:58.204430 22137 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:41:58.204468 22137 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:41:58.204522 22137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:41:58.205036 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22001
I20260812 16:41:58.205157 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:41:58.205271 22137 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7923fcac3bf425080e36a4365665b77" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41287 } }
I20260812 16:41:58.205385 22137 leader_election.cc:302] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7923fcac3bf425080e36a4365665b77; no voters:
I20260812 16:41:58.205542 22137 leader_election.cc:288] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:41:58.205605 22142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:41:58.205783 22137 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:41:58.205806 22142 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [term 1 LEADER]: Becoming Leader. State: Replica: e7923fcac3bf425080e36a4365665b77, State: Running, Role: LEADER
I20260812 16:41:58.205986 22142 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7923fcac3bf425080e36a4365665b77" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41287 } }
I20260812 16:41:58.206037 21961 external_mini_cluster.cc:1428] Setting key 3b5968c0ecf0798d125bfef58f65ab81
I20260812 16:41:58.206554 22146 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7923fcac3bf425080e36a4365665b77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7923fcac3bf425080e36a4365665b77" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41287 } } }
I20260812 16:41:58.206645 22146 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [sys.catalog]: This master's current role is: LEADER
I20260812 16:41:58.207047 22147 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7923fcac3bf425080e36a4365665b77. Latest consensus state: current_term: 1 leader_uuid: "e7923fcac3bf425080e36a4365665b77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7923fcac3bf425080e36a4365665b77" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41287 } } }
I20260812 16:41:58.207172 22147 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77 [sys.catalog]: This master's current role is: LEADER
I20260812 16:41:58.207510 22164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:41:58.208050 22164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:41:58.209487 22164 catalog_manager.cc:1347] Generated new cluster ID: 7175778f18da4c3ca6e213726b27a46a
I20260812 16:41:58.209540 22164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:41:58.212471 22164 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:41:58.212970 22164 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:41:58.220364 22164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7923fcac3bf425080e36a4365665b77: Generated new TSK 0
I20260812 16:41:58.220535 22164 catalog_manager.cc:1514] Initializing in-progress tserver states...
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:41:58.225063 22179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.207434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40642 (local address 127.21.114.126:41287)
0812 16:41:58.207783 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0812 16:41:58.207791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:41:58.208589 (+ 798us) server_negotiation.cc:407] Connection header received
0812 16:41:58.210928 (+ 2339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:41:58.210934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:41:58.210986 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:41:58.211120 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:41:58.213394 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.214755 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.216277 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.216900 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.216993 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.221422 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:41:58.221426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:41:58.221426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:41:58.221436 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:41:58.223096 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.223610 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.223613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.223613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.223703 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.223996 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.223997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.223997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.224214 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:41:58.224389 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 16:41:58.224680 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 16:41:58.224800 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:41:58.251370 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:41287
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:41:58.340984 22192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:41:58.341194 22192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:41:58.341218 22192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:41:58.342388 22192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:41:58.342433 22192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:41:58.342461 22192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:41:58.343950 22192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:41287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:41:58.344194 22192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:41:58.344462 22192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:41:58.349761 22208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.349850 22192 server_base.cc:1034] running on GCE node
W20260812 16:41:58.349726 22204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:41:58.349788 22205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.350164 22192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:41:58.350423 22192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:41:58.351581 22192 hybrid_clock.cc:648] HybridClock initialized: now 1786552918351559 us; error 35 us; skew 500 ppm
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:41:58.354195 22192 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:41:58.354648 22192 webserver.cc:460] Webserver started at http://127.21.114.65:44925/ using document root <none> and password file <none>
I20260812 16:41:58.354873 22192 fs_manager.cc:359] Metadata directory not provided
I20260812 16:41:58.354945 22192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:41:58.355096 22192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:41:58.356169 22192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "041f7a3a2c974f239256a448a73356b3"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "cc5d3e9c2361d0264afbc93de839945c"
server_key_iv: "cdd017546f090d8bfa5203e254ea6eb9"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.356623 22192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "041f7a3a2c974f239256a448a73356b3"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "cc5d3e9c2361d0264afbc93de839945c"
server_key_iv: "cdd017546f090d8bfa5203e254ea6eb9"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.357997 22192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:41:58.358789 22221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.358980 22192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:41:58.359097 22192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "041f7a3a2c974f239256a448a73356b3"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "cc5d3e9c2361d0264afbc93de839945c"
server_key_iv: "cdd017546f090d8bfa5203e254ea6eb9"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.359174 22192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:41:58.372756 22192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:41:58.374632 22192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:41:58.374788 22192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:41:58.375015 22192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:41:58.375331 22192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:41:58.375384 22192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.375432 22192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:41:58.375460 22192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.381635 22192 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:37303
I20260812 16:41:58.381709 22430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:37303 every 8 connection(s)
I20260812 16:41:58.382041 22192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:41:58.386914 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22192
I20260812 16:41:58.387012 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:41:58.387202 21961 external_mini_cluster.cc:1428] Setting key e67714b6094bfa0c60d1e317c213be76
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:41:58.391932 22435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.382868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:41287 (local address 127.21.114.65:36201)
0812 16:41:58.383039 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 16:41:58.383075 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:41:58.383547 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:41:58.383750 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:41:58.383753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:41:58.384399 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:41:58.384616 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:41:58.384622 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.385272 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.385273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:41:58.386059 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:41:58.386061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.386396 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.386397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:41:58.386509 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.387091 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:41:58.387101 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:41:58.388713 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:41:58.390598 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:41:58.390604 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:41:58.390606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:41:58.390831 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:41:58.391052 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:41:58.391053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:41:58.391053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:41:58.391155 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:41:58.391440 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:41:58.391445 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:41:58.391558 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 16:41:58.391639 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 16:41:58.391760 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
I20260812 16:41:58.391927 22179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.382889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:36201 (local address 127.21.114.126:41287)
0812 16:41:58.382936 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:41:58.382938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:41:58.383163 (+ 225us) server_negotiation.cc:407] Connection header received
0812 16:41:58.383630 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:41:58.383631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:41:58.383642 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:41:58.383694 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:41:58.384693 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.385193 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.386132 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.386326 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.386375 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.388811 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:41:58.388813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:41:58.388813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:41:58.388822 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:41:58.390511 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.390906 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.390908 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.390908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.390983 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.391217 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.391218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.391218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.391375 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:41:58.391448 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 16:41:58.391685 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 16:41:58.391789 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:41:58.392486 22431 heartbeater.cc:347] Connected to a master server at 127.21.114.126:41287
I20260812 16:41:58.392606 22431 heartbeater.cc:464] Registering TS with master...
I20260812 16:41:58.392810 22431 heartbeater.cc:511] Master 127.21.114.126:41287 requested a full tablet report, sending...
I20260812 16:41:58.393369 22072 ts_manager.cc:194] Registered new tserver with Master: 041f7a3a2c974f239256a448a73356b3 (127.21.114.65:37303)
I20260812 16:41:58.393981 22072 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:36201
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:41:58.415521 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:41287
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:41:58.500124 22440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:41:58.500356 22440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:41:58.500381 22440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:41:58.501523 22440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:41:58.501570 22440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:41:58.501597 22440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:41:58.503089 22440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:41287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:41:58.503352 22440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:41:58.503595 22440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:41:58.508780 22455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:41:58.508782 22451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:41:58.508780 22461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.509147 22440 server_base.cc:1034] running on GCE node
I20260812 16:41:58.509356 22440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:41:58.509619 22440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:41:58.510790 22440 hybrid_clock.cc:648] HybridClock initialized: now 1786552918510766 us; error 36 us; skew 500 ppm
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:41:58.513418 22440 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:41:58.513849 22440 webserver.cc:460] Webserver started at http://127.21.114.66:38441/ using document root <none> and password file <none>
I20260812 16:41:58.514111 22440 fs_manager.cc:359] Metadata directory not provided
I20260812 16:41:58.514178 22440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:41:58.514321 22440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:41:58.515376 22440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "1f689c6fdb8843a0b25d54d44cfd3d8b"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "1949e812971507be353b15bb0b462925"
server_key_iv: "4b221355b5733d1b6d5b011dae1bcd02"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.515743 22440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "1f689c6fdb8843a0b25d54d44cfd3d8b"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "1949e812971507be353b15bb0b462925"
server_key_iv: "4b221355b5733d1b6d5b011dae1bcd02"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.517160 22440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:41:58.517868 22477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.518014 22440 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:41:58.518136 22440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "1f689c6fdb8843a0b25d54d44cfd3d8b"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "1949e812971507be353b15bb0b462925"
server_key_iv: "4b221355b5733d1b6d5b011dae1bcd02"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.518209 22440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:41:58.530493 22440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:41:58.532855 22440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:41:58.533032 22440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:41:58.535292 22440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:41:58.535666 22440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:41:58.535763 22440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.535809 22440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:41:58.535830 22440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.542309 22440 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:41493
I20260812 16:41:58.542356 22689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:41493 every 8 connection(s)
I20260812 16:41:58.542680 22440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:41:58.551182 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22440
I20260812 16:41:58.551280 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:41:58.551467 21961 external_mini_cluster.cc:1428] Setting key 3363c238bd3f2d941f113f91216c030f
I20260812 16:41:58.551873 22179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.543468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:47461 (local address 127.21.114.126:41287)
0812 16:41:58.543548 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 16:41:58.543550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:41:58.543729 (+ 179us) server_negotiation.cc:407] Connection header received
0812 16:41:58.544218 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:41:58.544219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:41:58.544232 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:41:58.544289 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:41:58.545294 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.545786 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.546762 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.546960 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.547017 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.549117 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:41:58.549118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:41:58.549118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:41:58.549125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:41:58.550523 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.550865 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.550866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.550866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.550920 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.551140 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.551141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.551141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.551295 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:41:58.551384 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 16:41:58.551697 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 16:41:58.551783 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 16:41:58.552063 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.543425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:41287 (local address 127.21.114.66:47461)
0812 16:41:58.543608 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 16:41:58.543646 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:41:58.544136 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:41:58.544438 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:41:58.544442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:41:58.545009 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:41:58.545213 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:41:58.545218 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.545877 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.545878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:41:58.546685 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:41:58.546687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.547035 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.547035 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:41:58.547147 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.547614 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:41:58.547623 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:41:58.549029 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:41:58.550590 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:41:58.550596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:41:58.550597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:41:58.550802 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:41:58.550975 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:41:58.550976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:41:58.550976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:41:58.551074 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:41:58.551379 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:41:58.551383 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:41:58.551535 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 16:41:58.551657 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 16:41:58.551818 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260812 16:41:58.552524 22690 heartbeater.cc:347] Connected to a master server at 127.21.114.126:41287
I20260812 16:41:58.552624 22690 heartbeater.cc:464] Registering TS with master...
I20260812 16:41:58.552798 22690 heartbeater.cc:511] Master 127.21.114.126:41287 requested a full tablet report, sending...
I20260812 16:41:58.553203 22072 ts_manager.cc:194] Registered new tserver with Master: 1f689c6fdb8843a0b25d54d44cfd3d8b (127.21.114.66:41493)
I20260812 16:41:58.553587 22072 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:47461
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:41:58.578708 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:41287
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:38663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:41:58.662032 22702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:41:58.662266 22702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:41:58.662290 22702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:41:58.663493 22702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:41:58.663539 22702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:41:58.663566 22702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:41:58.665126 22702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:38663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:41287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:41:58.665381 22702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:41:58.665625 22702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:41:58.670866 22710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.670892 22702 server_base.cc:1034] running on GCE node
W20260812 16:41:58.670898 22715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:41:58.670876 22709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:41:58.671340 22702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:41:58.671546 22702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:41:58.672734 22702 hybrid_clock.cc:648] HybridClock initialized: now 1786552918672718 us; error 30 us; skew 500 ppm
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:41:58.675360 22702 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:41:58.675777 22702 webserver.cc:460] Webserver started at http://127.21.114.67:35007/ using document root <none> and password file <none>
I20260812 16:41:58.675971 22702 fs_manager.cc:359] Metadata directory not provided
I20260812 16:41:58.676012 22702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:41:58.676100 22702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:41:58.677160 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "0eb752d1ba64449785d208073c32ca21"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "142fcb3bf2769822c63c21e8a5d44125"
server_key_iv: "ec5974881670a2dea357c699c2ca8501"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.677551 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "0eb752d1ba64449785d208073c32ca21"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "142fcb3bf2769822c63c21e8a5d44125"
server_key_iv: "ec5974881670a2dea357c699c2ca8501"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.678828 22702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:41:58.679503 22724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.679701 22702 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:41:58.679798 22702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "0eb752d1ba64449785d208073c32ca21"
format_stamp: "Formatted at 2026-08-12 16:41:58 on dist-test-slave-45dx"
server_key: "142fcb3bf2769822c63c21e8a5d44125"
server_key_iv: "ec5974881670a2dea357c699c2ca8501"
server_key_version: "encryptionkey@0"
I20260812 16:41:58.679888 22702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:41:58.695305 22702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:41:58.697641 22702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:41:58.697754 22702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:41:58.697942 22702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:41:58.698256 22702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:41:58.698304 22702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.698328 22702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:41:58.698348 22702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:41:58.704706 22702 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:34929
I20260812 16:41:58.704761 22944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:34929 every 8 connection(s)
I20260812 16:41:58.705075 22702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:41:58.714093 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22702
I20260812 16:41:58.714207 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:41:58.714418 21961 external_mini_cluster.cc:1428] Setting key 3e05e111d85cb208ec160bc28ffe6b0f
I20260812 16:41:58.715001 22179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.705880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:59013 (local address 127.21.114.126:41287)
0812 16:41:58.705971 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 16:41:58.705974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:41:58.706215 (+ 241us) server_negotiation.cc:407] Connection header received
0812 16:41:58.706783 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:41:58.706784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:41:58.706795 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:41:58.706850 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:41:58.708034 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.708599 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.709581 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.709808 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.709870 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.711951 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:41:58.711952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:41:58.711952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:41:58.711959 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:41:58.713313 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.713774 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.713776 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.713776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.713842 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.714186 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.714188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.714189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.714346 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:41:58.714407 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 16:41:58.714793 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 16:41:58.714889 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 16:41:58.715093 22948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.705849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:41287 (local address 127.21.114.67:59013)
0812 16:41:58.706088 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 16:41:58.706133 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:41:58.706694 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:41:58.706922 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:41:58.706925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:41:58.707707 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:41:58.707931 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:41:58.707935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.708680 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.708681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:41:58.709499 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:41:58.709501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.709902 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.709903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:41:58.710004 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.710477 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:41:58.710486 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:41:58.711857 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:41:58.713412 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:41:58.713418 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:41:58.713421 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:41:58.713657 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:41:58.713935 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:41:58.713937 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:41:58.713937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:41:58.714096 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:41:58.714417 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:41:58.714425 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:41:58.714599 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 16:41:58.714747 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 16:41:58.714887 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":107,"threads_started":1}
I20260812 16:41:58.715560 22946 heartbeater.cc:347] Connected to a master server at 127.21.114.126:41287
I20260812 16:41:58.715664 22946 heartbeater.cc:464] Registering TS with master...
I20260812 16:41:58.715888 22946 heartbeater.cc:511] Master 127.21.114.126:41287 requested a full tablet report, sending...
I20260812 16:41:58.716214 22072 ts_manager.cc:194] Registered new tserver with Master: 0eb752d1ba64449785d208073c32ca21 (127.21.114.67:34929)
I20260812 16:41:58.716620 22072 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:59013
I20260812 16:41:58.726572 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:41:58.751487 22956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.743487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37120 (local address 127.21.114.65:37303)
0812 16:41:58.743696 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 16:41:58.743702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:41:58.743713 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:41:58.743742 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:41:58.743744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:41:58.743759 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:41:58.743834 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:41:58.744457 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.745184 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.745918 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.746336 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.746397 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.748784 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:41:58.748793 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:41:58.748793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:41:58.748800 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:41:58.750463 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.750763 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.750766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.750766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.750826 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.750981 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.750981 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.750982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.751104 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:41:58.751224 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 16:41:58.751259 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 16:41:58.751323 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":128,"threads_started":1}
W20260812 16:41:58.751883 22275 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37120
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[21974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:41:58.775092 22956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:41:58.768267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37134 (local address 127.21.114.65:37303)
0812 16:41:58.768365 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 16:41:58.768367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:41:58.768441 (+ 74us) server_negotiation.cc:407] Connection header received
0812 16:41:58.768539 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:41:58.768540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:41:58.768561 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:41:58.768623 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:41:58.769208 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.769718 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.770458 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:41:58.770665 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:41:58.770740 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:41:58.773021 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:41:58.773022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:41:58.773022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:41:58.773028 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:41:58.774199 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.774508 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.774509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.774509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.774561 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:41:58.774718 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:41:58.774718 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:41:58.774719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:41:58.774806 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:41:58.774896 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 16:41:58.774962 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 16:41:58.775023 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 16:41:58.775662 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22192
I20260812 16:41:58.789283 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22440
I20260812 16:41:58.796950 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22702
I20260812 16:41:58.809448 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22001
2026-08-12T16:41:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2209 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[22973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[22973](info): set up 2 sockets
Aug 12 16:41:58 dist-test-slave-45dx krb5kdc[22973](info): commencing operation
krb5kdc: starting...
W20260812 16:42:00.159812 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:00.286397 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:39891
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:39891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:00.368829 22999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:00.369040 22999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:00.369063 22999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:00.370148 22999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:00.370185 22999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:00.370199 22999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:00.370213 22999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:00.370225 22999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:00.371626 22999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:39891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:39891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:00.371824 22999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:00.372004 22999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:00.377091 23007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.377081 23006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.377080 23010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:00.377107 22999 server_base.cc:1034] running on GCE node
I20260812 16:42:00.377568 22999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:00.377848 22999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:00.378999 22999 hybrid_clock.cc:648] HybridClock initialized: now 1786552920378983 us; error 33 us; skew 500 ppm
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:00.381520 22999 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:00.382001 22999 webserver.cc:460] Webserver started at http://127.21.114.126:37387/ using document root <none> and password file <none>
I20260812 16:42:00.382225 22999 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:00.382272 22999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:00.382438 22999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:00.383499 22999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "11e00d78ac004db291b33af0e15ba3a7"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "7c0b7d35b1fc37e2a70066f3cb4c73b5"
server_key_iv: "416882a9dfc048c9f12a6f675ecab9ae"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.383941 22999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "11e00d78ac004db291b33af0e15ba3a7"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "7c0b7d35b1fc37e2a70066f3cb4c73b5"
server_key_iv: "416882a9dfc048c9f12a6f675ecab9ae"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.385370 22999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:00.386123 23020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.386312 22999 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:00.386399 22999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "11e00d78ac004db291b33af0e15ba3a7"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "7c0b7d35b1fc37e2a70066f3cb4c73b5"
server_key_iv: "416882a9dfc048c9f12a6f675ecab9ae"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.386458 22999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:00.406394 22999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:00.408876 22999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:00.408993 22999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:00.413093 22999 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:39891
I20260812 16:42:00.413159 23125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:39891 every 8 connection(s)
I20260812 16:42:00.413544 22999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:00.414489 23126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:00.416870 23126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7: Bootstrap starting.
I20260812 16:42:00.417428 23126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:00.417659 23126 log.cc:824] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:00.418367 23126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7: No bootstrap required, opened a new log
I20260812 16:42:00.419909 23126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e00d78ac004db291b33af0e15ba3a7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39891 } }
I20260812 16:42:00.420051 23126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:00.420074 23126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11e00d78ac004db291b33af0e15ba3a7, State: Initialized, Role: FOLLOWER
I20260812 16:42:00.420210 23126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e00d78ac004db291b33af0e15ba3a7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39891 } }
I20260812 16:42:00.420293 23126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:00.420344 23126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:00.420408 23126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:00.420905 23126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e00d78ac004db291b33af0e15ba3a7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39891 } }
I20260812 16:42:00.420997 23126 leader_election.cc:302] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11e00d78ac004db291b33af0e15ba3a7; no voters:
I20260812 16:42:00.421132 23126 leader_election.cc:288] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:00.421224 23132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:00.421334 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22999
I20260812 16:42:00.421416 23126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:00.421435 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:00.421468 23132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [term 1 LEADER]: Becoming Leader. State: Replica: 11e00d78ac004db291b33af0e15ba3a7, State: Running, Role: LEADER
I20260812 16:42:00.421603 21961 external_mini_cluster.cc:1428] Setting key 5621571f9bd61dc88d2a4cd9e166599f
I20260812 16:42:00.421566 23132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e00d78ac004db291b33af0e15ba3a7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39891 } }
I20260812 16:42:00.421980 23134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11e00d78ac004db291b33af0e15ba3a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e00d78ac004db291b33af0e15ba3a7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39891 } } }
I20260812 16:42:00.422082 23134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:00.422267 23135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11e00d78ac004db291b33af0e15ba3a7. Latest consensus state: current_term: 1 leader_uuid: "11e00d78ac004db291b33af0e15ba3a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e00d78ac004db291b33af0e15ba3a7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39891 } } }
I20260812 16:42:00.422408 23135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:00.422324 23154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:00.423013 23154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:00.424983 23154 catalog_manager.cc:1347] Generated new cluster ID: 8456b471cdde40a99641661f97989653
I20260812 16:42:00.425038 23154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:00.434701 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.422297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.21.114.126:39891)
0812 16:42:00.423442 (+ 1145us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.423452 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.423487 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:42:00.423797 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.423807 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.423875 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.424025 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:00.424863 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.426260 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.427314 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.427998 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.428119 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.430949 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:00.430953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:00.430954 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:00.430967 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:00.432972 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.433393 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.433396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.433396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.433502 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.433720 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.433720 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.433721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.434048 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:00.434202 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.434323 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.434466 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1095,"thread_start_us":81,"threads_started":1}
I20260812 16:42:00.451766 23154 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:00.452677 23154 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:00.458160 23154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11e00d78ac004db291b33af0e15ba3a7: Generated new TSK 0
I20260812 16:42:00.458341 23154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:00.489413 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:39891
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:00.575289 23182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:00.575536 23182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:00.575579 23182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:00.576735 23182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:00.576799 23182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:00.576843 23182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:00.578332 23182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:39891
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:00.578606 23182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:00.578835 23182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:00.583892 23194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.583894 23200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.583925 23192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:00.584142 23182 server_base.cc:1034] running on GCE node
I20260812 16:42:00.584403 23182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:00.584664 23182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:00.585825 23182 hybrid_clock.cc:648] HybridClock initialized: now 1786552920585814 us; error 39 us; skew 500 ppm
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:00.588289 23182 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:00.588760 23182 webserver.cc:460] Webserver started at http://127.21.114.65:42091/ using document root <none> and password file <none>
I20260812 16:42:00.589003 23182 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:00.589069 23182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:00.589205 23182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:00.590251 23182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "c7ff1b5584d94098b16a12ca7636be22"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "07e66c4fb85d7b13bb6a9c347b3b1e4c"
server_key_iv: "d043f3cec550e10ae81410797e6e3276"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.590616 23182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "c7ff1b5584d94098b16a12ca7636be22"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "07e66c4fb85d7b13bb6a9c347b3b1e4c"
server_key_iv: "d043f3cec550e10ae81410797e6e3276"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.591948 23182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 16:42:00.592706 23209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.592856 23182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.592969 23182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "c7ff1b5584d94098b16a12ca7636be22"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "07e66c4fb85d7b13bb6a9c347b3b1e4c"
server_key_iv: "d043f3cec550e10ae81410797e6e3276"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.593042 23182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:00.608639 23182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:00.610526 23182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:00.610692 23182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:00.610932 23182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:00.611264 23182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:00.611325 23182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.611366 23182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:00.611393 23182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.617270 23182 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:45695
I20260812 16:42:00.617318 23428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:45695 every 8 connection(s)
I20260812 16:42:00.617641 23182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:00.625366 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23182
I20260812 16:42:00.625469 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:00.625669 21961 external_mini_cluster.cc:1428] Setting key 2dcc4665927751399140b61e51113466
I20260812 16:42:00.627341 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.618381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:35041 (local address 127.21.114.126:39891)
0812 16:42:00.618441 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.618443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.618672 (+ 229us) server_negotiation.cc:407] Connection header received
0812 16:42:00.619595 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.619596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.619606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.619666 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:00.620275 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.620831 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.621906 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.622107 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.622157 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.624349 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:00.624350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:00.624351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:00.624358 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:00.625859 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.626319 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.626321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.626321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.626394 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.626708 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.626709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.626709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.626817 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:00.626870 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.627206 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.627277 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 16:42:00.627661 23432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.618363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:39891 (local address 127.21.114.65:35041)
0812 16:42:00.618542 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:00.618587 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:00.619507 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:00.619723 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:00.619727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:00.619998 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:00.620203 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.620207 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.620914 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.620915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.621822 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.621826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.622174 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.622175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.622277 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.622813 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:00.622822 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:00.624218 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:00.625954 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:00.625963 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:00.625966 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:00.626245 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:00.626470 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:00.626471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:00.626471 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:00.626634 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:00.626880 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:00.626888 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:00.627064 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 16:42:00.627184 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 16:42:00.627383 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":105,"threads_started":1}
I20260812 16:42:00.628268 23429 heartbeater.cc:347] Connected to a master server at 127.21.114.126:39891
I20260812 16:42:00.628391 23429 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:00.628576 23429 heartbeater.cc:511] Master 127.21.114.126:39891 requested a full tablet report, sending...
I20260812 16:42:00.629158 23059 ts_manager.cc:194] Registered new tserver with Master: c7ff1b5584d94098b16a12ca7636be22 (127.21.114.65:45695)
I20260812 16:42:00.629884 23059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:35041
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:00.651250 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:39891
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:00.733870 23435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:00.734088 23435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:00.734112 23435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:00.735206 23435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:00.735239 23435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:00.735266 23435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:00.736765 23435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:39891
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:00.736961 23435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:00.737138 23435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:00.742093 23444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.742069 23442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.742065 23440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:00.742336 23435 server_base.cc:1034] running on GCE node
I20260812 16:42:00.742564 23435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:00.742792 23435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:00.743958 23435 hybrid_clock.cc:648] HybridClock initialized: now 1786552920743944 us; error 27 us; skew 500 ppm
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:00.746603 23435 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:00.746994 23435 webserver.cc:460] Webserver started at http://127.21.114.66:46553/ using document root <none> and password file <none>
I20260812 16:42:00.747172 23435 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:00.747213 23435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:00.747303 23435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:00.748363 23435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "cb441653d4914ec3a00ca3e6aa928036"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "77d93daf72325a727cbddde5f9ea1d46"
server_key_iv: "7df4546123fa99e41eb0d3ea537d5960"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.748695 23435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "cb441653d4914ec3a00ca3e6aa928036"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "77d93daf72325a727cbddde5f9ea1d46"
server_key_iv: "7df4546123fa99e41eb0d3ea537d5960"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.749984 23435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:00.750706 23452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.750870 23435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:00.750959 23435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "cb441653d4914ec3a00ca3e6aa928036"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "77d93daf72325a727cbddde5f9ea1d46"
server_key_iv: "7df4546123fa99e41eb0d3ea537d5960"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.751014 23435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:00.773132 23435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:00.775033 23435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:00.775151 23435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:00.775352 23435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:00.775640 23435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:00.775672 23435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.775695 23435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:00.775707 23435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.781494 23435 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:40199
I20260812 16:42:00.781543 23663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:40199 every 8 connection(s)
I20260812 16:42:00.781910 23435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:00.786201 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23435
I20260812 16:42:00.786293 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:00.786489 21961 external_mini_cluster.cc:1428] Setting key 5df31785581870585697f7cfd3c0376c
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:00.791939 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.782629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:39891 (local address 127.21.114.66:50095)
0812 16:42:00.782801 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:00.782838 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:00.783753 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:00.783979 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:00.783983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:00.784242 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:00.784510 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.784515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.785152 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.785152 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.785959 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.785961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.786444 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.786445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.786551 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.787098 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:00.787109 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:00.788776 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:00.790623 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:00.790629 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:00.790631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:00.790853 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:00.791063 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:00.791063 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:00.791064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:00.791163 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:00.791449 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:00.791453 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:00.791564 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 16:42:00.791646 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 16:42:00.791765 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260812 16:42:00.791932 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.782666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:50095 (local address 127.21.114.126:39891)
0812 16:42:00.782711 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.782713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.782923 (+ 210us) server_negotiation.cc:407] Connection header received
0812 16:42:00.783859 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.783860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.783871 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.783911 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:00.784585 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.785076 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.786041 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.786360 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.786439 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.788877 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:00.788878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:00.788878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:00.788886 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:00.790553 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.790926 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.790927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.790927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.790995 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.791224 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.791226 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.791226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.791384 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:00.791454 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.791690 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.791786 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:00.792487 23666 heartbeater.cc:347] Connected to a master server at 127.21.114.126:39891
I20260812 16:42:00.792596 23666 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:00.792769 23666 heartbeater.cc:511] Master 127.21.114.126:39891 requested a full tablet report, sending...
I20260812 16:42:00.793179 23059 ts_manager.cc:194] Registered new tserver with Master: cb441653d4914ec3a00ca3e6aa928036 (127.21.114.66:40199)
I20260812 16:42:00.793732 23059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:50095
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:00.813264 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:39891
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:00.898622 23671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:00.898834 23671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:00.898859 23671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:00.899953 23671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:00.899988 23671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:00.900014 23671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:00.901468 23671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:39891
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:00.901650 23671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:00.901837 23671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:00.906863 23680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.906877 23695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:00.906881 23679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:00.907227 23671 server_base.cc:1034] running on GCE node
I20260812 16:42:00.907440 23671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:00.907672 23671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:00.908824 23671 hybrid_clock.cc:648] HybridClock initialized: now 1786552920908828 us; error 48 us; skew 500 ppm
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:00.911365 23671 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:00.911818 23671 webserver.cc:460] Webserver started at http://127.21.114.67:35905/ using document root <none> and password file <none>
I20260812 16:42:00.912038 23671 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:00.912082 23671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:00.912237 23671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:00.913304 23671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "0df7afb1ff284faa9ae5459bc60f9c41"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "90619fab37549a730e9a3e0ab10f0c82"
server_key_iv: "487ef03f477c72bbca4dc9bb7ed3f4c1"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.913669 23671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "0df7afb1ff284faa9ae5459bc60f9c41"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "90619fab37549a730e9a3e0ab10f0c82"
server_key_iv: "487ef03f477c72bbca4dc9bb7ed3f4c1"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.915009 23671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:00.915781 23705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.915948 23671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:00.916049 23671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "0df7afb1ff284faa9ae5459bc60f9c41"
format_stamp: "Formatted at 2026-08-12 16:42:00 on dist-test-slave-45dx"
server_key: "90619fab37549a730e9a3e0ab10f0c82"
server_key_iv: "487ef03f477c72bbca4dc9bb7ed3f4c1"
server_key_version: "encryptionkey@0"
I20260812 16:42:00.916126 23671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:00.936039 23671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:00.937983 23671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:00.938146 23671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:00.938436 23671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:00.938831 23671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:00.938879 23671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.938915 23671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:00.938944 23671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:00.945137 23671 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:43391
I20260812 16:42:00.945181 23930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:43391 every 8 connection(s)
I20260812 16:42:00.945539 23671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:00.948611 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23671
I20260812 16:42:00.948714 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:00.948905 21961 external_mini_cluster.cc:1428] Setting key ba4bb5811d7eb05924b014209b2526a8
Aug 12 16:42:00 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:00.954862 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.946278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:33111 (local address 127.21.114.126:39891)
0812 16:42:00.946342 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.946344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.946573 (+ 229us) server_negotiation.cc:407] Connection header received
0812 16:42:00.947528 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.947529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.947539 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.947580 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:00.948180 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.948742 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.949964 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.950150 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.950202 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.952356 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:00.952358 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:00.952358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:00.952366 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:00.953542 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.953985 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.953986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.953987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.954041 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.954287 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.954288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.954288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.954391 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:00.954443 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.954716 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.954798 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:42:00.955056 23936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.946261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:39891 (local address 127.21.114.67:33111)
0812 16:42:00.946433 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:00.946476 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:00.947421 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:00.947644 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:00.947648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:00.947908 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:00.948112 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.948117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.948840 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.948842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.949886 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.949889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.950219 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.950220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.950326 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.950855 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:00.950863 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:00.952238 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:00.953665 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:00.953672 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:00.953674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:00.953918 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:00.954113 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:00.954114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:00.954114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:00.954229 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:00.954450 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:00.954455 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:00.954586 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 16:42:00.954668 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 16:42:00.954841 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
I20260812 16:42:00.955506 23931 heartbeater.cc:347] Connected to a master server at 127.21.114.126:39891
I20260812 16:42:00.955614 23931 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:00.955806 23931 heartbeater.cc:511] Master 127.21.114.126:39891 requested a full tablet report, sending...
I20260812 16:42:00.956175 23059 ts_manager.cc:194] Registered new tserver with Master: 0df7afb1ff284faa9ae5459bc60f9c41 (127.21.114.67:43391)
I20260812 16:42:00.956590 23059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:33111
I20260812 16:42:00.960628 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:42:00.967410 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.962105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60372 (local address 127.21.114.126:39891)
0812 16:42:00.962173 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.962175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.962228 (+ 53us) server_negotiation.cc:407] Connection header received
0812 16:42:00.962271 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.962272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.962280 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.962328 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:00.962836 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.963288 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.963935 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.964111 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.964159 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.965346 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:00.965347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:00.965348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:00.965353 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:00.966483 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.966781 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.966782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.966782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.966831 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:00.966991 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:00.966992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:00.966992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:00.967118 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:00.967191 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.967276 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.967331 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:42:00.969591 23059 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:00.971148 23059 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:00.977519 23955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.973619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47502 (local address 127.21.114.66:40199)
0812 16:42:00.974024 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.974028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.974036 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:00.974066 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.974067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.974080 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.974164 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:00.974325 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.975024 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.976360 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.977102 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.977175 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.977229 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.977391 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.977432 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":80,"threads_started":1}
I20260812 16:42:00.977520 23952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.973505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40199 (local address 127.0.0.1:47502)
0812 16:42:00.973787 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:00.973819 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:00.973888 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:00.974170 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:00.974174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:00.974176 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:00.974243 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.974245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.975126 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.975127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.976237 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.976240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.977193 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.977194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.977274 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.977288 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 16:42:00.977367 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 16:42:00.977430 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":94,"threads_started":1}
I20260812 16:42:00.977859 23954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.973492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45695 (local address 127.0.0.1:34264)
0812 16:42:00.973771 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:00.973815 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:00.973886 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:00.974287 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:00.974288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:00.974290 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:00.974332 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.974333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.975609 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.975610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.976670 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.976672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.977503 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.977504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.977565 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.977570 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:00.977745 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 16:42:00.977791 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":72,"threads_started":1}
I20260812 16:42:00.978279 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.973900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34264 (local address 127.21.114.65:45695)
0812 16:42:00.974098 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.974102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.974113 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:00.974156 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.974158 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.974175 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.974284 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:00.974393 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.975496 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.976766 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.977409 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.978114 (+ 705us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.978166 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.978188 (+ 22us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.978220 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":126,"threads_started":1}
I20260812 16:42:00.978387 23544 tablet_service.cc:1467] Processing CreateTablet for tablet caf237a4fce64239bed8699838fda97f (DEFAULT_TABLE table=test-table [id=2c1f54fca0174ab18264ec72719c676c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:00.978766 23544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf237a4fce64239bed8699838fda97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:00.978971 23296 tablet_service.cc:1467] Processing CreateTablet for tablet caf237a4fce64239bed8699838fda97f (DEFAULT_TABLE table=test-table [id=2c1f54fca0174ab18264ec72719c676c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:00.979372 23296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf237a4fce64239bed8699838fda97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:00.982272 23961 tablet_bootstrap.cc:492] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: Bootstrap starting.
I20260812 16:42:00.982520 23951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.973539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:43391 (local address 127.0.0.1:51854)
0812 16:42:00.974117 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:00.974129 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:00.974185 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:00.974778 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:00.974779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:00.974781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:00.974821 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.974822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.975898 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.975900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.976823 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:00.976826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.977913 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.977914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:00.982330 (+ 4416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.982336 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:42:00.982403 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 16:42:00.982446 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":69,"threads_started":1}
I20260812 16:42:00.982832 23956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:00.973743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51854 (local address 127.21.114.67:43391)
0812 16:42:00.973921 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:00.973927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:00.974249 (+ 322us) server_negotiation.cc:407] Connection header received
0812 16:42:00.974604 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:00.974607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:00.974622 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:00.974697 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:00.974890 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.975805 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.976912 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:00.977813 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:00.977909 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:00.977967 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:00.982693 (+ 4726us) server_negotiation.cc:299] Negotiation successful
0812 16:42:00.982744 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":76,"threads_started":1}
I20260812 16:42:00.983003 23965 tablet_bootstrap.cc:492] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: Bootstrap starting.
I20260812 16:42:00.983034 23961 tablet_bootstrap.cc:654] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:00.983557 23961 log.cc:824] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:00.983460 23796 tablet_service.cc:1467] Processing CreateTablet for tablet caf237a4fce64239bed8699838fda97f (DEFAULT_TABLE table=test-table [id=2c1f54fca0174ab18264ec72719c676c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:00.983662 23965 tablet_bootstrap.cc:654] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:00.983806 23796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf237a4fce64239bed8699838fda97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:00.984243 23965 log.cc:824] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:00.984489 23961 tablet_bootstrap.cc:492] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: No bootstrap required, opened a new log
I20260812 16:42:00.984571 23961 ts_tablet_manager.cc:1397] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:00.985071 23965 tablet_bootstrap.cc:492] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: No bootstrap required, opened a new log
I20260812 16:42:00.985146 23965 ts_tablet_manager.cc:1397] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 16:42:00.986279 23961 raft_consensus.cc:348] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:00.986444 23961 raft_consensus.cc:374] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:00.986491 23961 raft_consensus.cc:729] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb441653d4914ec3a00ca3e6aa928036, State: Initialized, Role: FOLLOWER
I20260812 16:42:00.986606 23961 consensus_queue.cc:260] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:00.986893 23961 ts_tablet_manager.cc:1428] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:00.987043 23666 heartbeater.cc:503] Master 127.21.114.126:39891 was elected leader, sending a full tablet report...
I20260812 16:42:00.987258 23971 tablet_bootstrap.cc:492] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: Bootstrap starting.
I20260812 16:42:00.987193 23965 raft_consensus.cc:348] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:00.987360 23965 raft_consensus.cc:374] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:00.987394 23965 raft_consensus.cc:729] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ff1b5584d94098b16a12ca7636be22, State: Initialized, Role: FOLLOWER
I20260812 16:42:00.987545 23965 consensus_queue.cc:260] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:00.987846 23965 ts_tablet_manager.cc:1428] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:42:00.987890 23971 tablet_bootstrap.cc:654] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:00.988001 23429 heartbeater.cc:503] Master 127.21.114.126:39891 was elected leader, sending a full tablet report...
I20260812 16:42:00.988516 23971 log.cc:824] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:00.989230 23971 tablet_bootstrap.cc:492] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: No bootstrap required, opened a new log
I20260812 16:42:00.989297 23971 ts_tablet_manager.cc:1397] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 16:42:00.990537 23971 raft_consensus.cc:348] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:00.990659 23971 raft_consensus.cc:374] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:00.990681 23971 raft_consensus.cc:729] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0df7afb1ff284faa9ae5459bc60f9c41, State: Initialized, Role: FOLLOWER
I20260812 16:42:00.990785 23971 consensus_queue.cc:260] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:00.991036 23971 ts_tablet_manager.cc:1428] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 16:42:00.991066 23931 heartbeater.cc:503] Master 127.21.114.126:39891 was elected leader, sending a full tablet report...
W20260812 16:42:01.032660 23667 tablet.cc:2369] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:01.118368 23431 tablet.cc:2369] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:01.196141 23932 tablet.cc:2369] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:01.221737 23974 raft_consensus.cc:482] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:01.221890 23974 raft_consensus.cc:504] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:01.222446 23974 leader_election.cc:288] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7ff1b5584d94098b16a12ca7636be22 (127.21.114.65:45695), cb441653d4914ec3a00ca3e6aa928036 (127.21.114.66:40199)
I20260812 16:42:01.225346 23936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.222653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45695 (local address 127.21.114.67:57051)
0812 16:42:01.222716 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:01.222729 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:01.222779 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:01.222937 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:01.222938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:01.222939 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:01.223034 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:01.223036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.223685 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.223687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:01.224519 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:01.224522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.225074 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.225075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:01.225161 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.225164 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:01.225225 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 16:42:01.225268 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":34}
I20260812 16:42:01.225346 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.222695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:57051 (local address 127.21.114.65:45695)
0812 16:42:01.222746 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:01.222749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:01.222766 (+ 17us) server_negotiation.cc:407] Connection header received
0812 16:42:01.222860 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:01.222862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:01.222872 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:01.222929 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:01.223109 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.223594 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.224618 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.224988 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.225073 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.225083 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:01.225245 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 16:42:01.225283 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:01.225530 23955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.222740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:34525 (local address 127.21.114.66:40199)
0812 16:42:01.222800 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:01.222802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:01.222955 (+ 153us) server_negotiation.cc:407] Connection header received
0812 16:42:01.223045 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:01.223046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:01.223057 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:01.223108 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:01.223269 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.223732 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.224761 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.225141 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.225227 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.225236 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:01.225389 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 16:42:01.225432 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:01.225731 23975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.222668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40199 (local address 127.21.114.67:34525)
0812 16:42:01.222875 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:01.222885 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:01.222968 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:01.223113 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:01.223114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:01.223115 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:01.223191 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:01.223193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.223823 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.223825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:01.224669 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:01.224672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.225240 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.225241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:01.225313 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.225317 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:01.225381 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:42:01.225646 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":1,"thread_start_us":127,"threads_started":1}
I20260812 16:42:01.225718 23337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf237a4fce64239bed8699838fda97f" candidate_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ff1b5584d94098b16a12ca7636be22" is_pre_election: true
I20260812 16:42:01.225891 23337 raft_consensus.cc:2454] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0df7afb1ff284faa9ae5459bc60f9c41 in term 0.
I20260812 16:42:01.226128 23586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf237a4fce64239bed8699838fda97f" candidate_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb441653d4914ec3a00ca3e6aa928036" is_pre_election: true
I20260812 16:42:01.226188 23706 leader_election.cc:302] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df7afb1ff284faa9ae5459bc60f9c41, c7ff1b5584d94098b16a12ca7636be22; no voters:
I20260812 16:42:01.226279 23586 raft_consensus.cc:2454] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0df7afb1ff284faa9ae5459bc60f9c41 in term 0.
I20260812 16:42:01.226320 23974 raft_consensus.cc:2781] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:01.226418 23974 raft_consensus.cc:482] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:01.226467 23974 raft_consensus.cc:3037] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:01.227252 23974 raft_consensus.cc:504] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:01.227438 23974 leader_election.cc:288] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [CANDIDATE]: Term 1 election: Requested vote from peers c7ff1b5584d94098b16a12ca7636be22 (127.21.114.65:45695), cb441653d4914ec3a00ca3e6aa928036 (127.21.114.66:40199)
I20260812 16:42:01.227596 23586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf237a4fce64239bed8699838fda97f" candidate_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb441653d4914ec3a00ca3e6aa928036"
I20260812 16:42:01.227638 23337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf237a4fce64239bed8699838fda97f" candidate_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ff1b5584d94098b16a12ca7636be22"
I20260812 16:42:01.227689 23586 raft_consensus.cc:3037] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:01.227742 23337 raft_consensus.cc:3037] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:01.228507 23586 raft_consensus.cc:2454] T caf237a4fce64239bed8699838fda97f P cb441653d4914ec3a00ca3e6aa928036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0df7afb1ff284faa9ae5459bc60f9c41 in term 1.
I20260812 16:42:01.228510 23337 raft_consensus.cc:2454] T caf237a4fce64239bed8699838fda97f P c7ff1b5584d94098b16a12ca7636be22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0df7afb1ff284faa9ae5459bc60f9c41 in term 1.
I20260812 16:42:01.228675 23706 leader_election.cc:302] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df7afb1ff284faa9ae5459bc60f9c41, c7ff1b5584d94098b16a12ca7636be22; no voters:
I20260812 16:42:01.228789 23974 raft_consensus.cc:2781] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:01.228968 23974 raft_consensus.cc:686] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [term 1 LEADER]: Becoming Leader. State: Replica: 0df7afb1ff284faa9ae5459bc60f9c41, State: Running, Role: LEADER
I20260812 16:42:01.229079 23974 consensus_queue.cc:237] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } }
I20260812 16:42:01.230000 23059 catalog_manager.cc:5495] T caf237a4fce64239bed8699838fda97f P 0df7afb1ff284faa9ae5459bc60f9c41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0df7afb1ff284faa9ae5459bc60f9c41 (127.21.114.67). New cstate: current_term: 1 leader_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ff1b5584d94098b16a12ca7636be22" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb441653d4914ec3a00ca3e6aa928036" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0df7afb1ff284faa9ae5459bc60f9c41" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43391 } health_report { overall_health: HEALTHY } } }
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:01.269181 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.260748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34268 (local address 127.21.114.65:45695)
0812 16:42:01.260855 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:01.260858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:01.260967 (+ 109us) server_negotiation.cc:407] Connection header received
0812 16:42:01.261079 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:01.261080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:01.261094 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:01.261160 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:01.261901 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.262458 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.263282 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.263501 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.263585 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.266184 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:01.266201 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:01.266201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:01.266216 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:01.267816 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:01.268244 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:01.268249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:01.268249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:01.268381 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:01.268596 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:01.268597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:01.268598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:01.268770 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:01.268935 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:01.268975 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 16:42:01.269063 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552921, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:01.294638 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.286800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34272 (local address 127.21.114.65:45695)
0812 16:42:01.286893 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:01.286896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:01.286977 (+ 81us) server_negotiation.cc:407] Connection header received
0812 16:42:01.287084 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:01.287085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:01.287102 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:01.287170 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:01.287824 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.288427 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.289214 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.289467 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.289550 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.291949 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:01.291951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:01.291951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:01.291965 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:01.293336 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:01.293740 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:01.293742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:01.293742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:01.293832 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:01.294031 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:01.294032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:01.294032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:01.294138 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:01.294241 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:01.294447 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 16:42:01.294529 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[22973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[22973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:01.318734 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:01.311657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34284 (local address 127.21.114.65:45695)
0812 16:42:01.311730 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:01.311734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:01.311842 (+ 108us) server_negotiation.cc:407] Connection header received
0812 16:42:01.311926 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:01.311927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:01.311941 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:01.312005 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:01.312635 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.313144 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.313894 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:01.314084 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:01.314165 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:01.316423 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:01.316425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:01.316425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:01.316433 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:01.317809 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:01.318107 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:01.318108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:01.318108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:01.318173 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:01.318314 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:01.318314 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:01.318315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:01.318422 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:01.318485 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:01.318577 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 16:42:01.318634 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 16:42:01.319286 23265 tablet_service.cc:2908] Rejecting scan request for tablet caf237a4fce64239bed8699838fda97f: Uninitialized: clean time has not yet been initialized
I20260812 16:42:01.320158 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23182
I20260812 16:42:01.328914 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23435
I20260812 16:42:01.353268 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23671
I20260812 16:42:01.367751 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22999
2026-08-12T16:42:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2560 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[24007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[24007](info): set up 2 sockets
Aug 12 16:42:01 dist-test-slave-45dx krb5kdc[24007](info): commencing operation
krb5kdc: starting...
W20260812 16:42:02.706413 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:02 dist-test-slave-45dx krb5kdc[24007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:02.827042 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:43431
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:43431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:02.909157 24036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:02.909403 24036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:02.909440 24036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:02.910599 24036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:02.910669 24036 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 16:42:02.910691 24036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:02.910712 24036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:02.910744 24036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:02.910775 24036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:02.912352 24036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:43431
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:43431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:02.912631 24036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:02.912879 24036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:02.918043 24050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:02.918053 24043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:02.918102 24036 server_base.cc:1034] running on GCE node
W20260812 16:42:02.918054 24044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:02.918430 24036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:02.918704 24036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:02.919864 24036 hybrid_clock.cc:648] HybridClock initialized: now 1786552922919848 us; error 30 us; skew 500 ppm
Aug 12 16:42:02 dist-test-slave-45dx krb5kdc[24007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552922, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:02.922469 24036 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:02.922911 24036 webserver.cc:460] Webserver started at http://127.21.114.126:44273/ using document root <none> and password file <none>
I20260812 16:42:02.923156 24036 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:02.923204 24036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:02.923363 24036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:02.924542 24036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "b80617551dc64aae9c59bf8d4b06da18"
format_stamp: "Formatted at 2026-08-12 16:42:02 on dist-test-slave-45dx"
server_key: "dc69d7b3842d91e2459cead9425a0705"
server_key_iv: "0ecff686b148f0fd911f06f855fb784a"
server_key_version: "encryptionkey@0"
I20260812 16:42:02.924922 24036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "b80617551dc64aae9c59bf8d4b06da18"
format_stamp: "Formatted at 2026-08-12 16:42:02 on dist-test-slave-45dx"
server_key: "dc69d7b3842d91e2459cead9425a0705"
server_key_iv: "0ecff686b148f0fd911f06f855fb784a"
server_key_version: "encryptionkey@0"
I20260812 16:42:02.926329 24036 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:02.927057 24062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:02.927223 24036 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:02.927330 24036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b80617551dc64aae9c59bf8d4b06da18"
format_stamp: "Formatted at 2026-08-12 16:42:02 on dist-test-slave-45dx"
server_key: "dc69d7b3842d91e2459cead9425a0705"
server_key_iv: "0ecff686b148f0fd911f06f855fb784a"
server_key_version: "encryptionkey@0"
I20260812 16:42:02.927405 24036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:02.961913 24036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:02.963889 24036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:02.964062 24036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:02.969048 24036 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:43431
I20260812 16:42:02.969110 24192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:43431 every 8 connection(s)
I20260812 16:42:02.969435 24036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:02.970060 24193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:02.972139 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24036
I20260812 16:42:02.972242 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:02.972452 21961 external_mini_cluster.cc:1428] Setting key f643fd99ae07bbc86fb6c0f368702d2f
I20260812 16:42:02.972836 24193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: Bootstrap starting.
I20260812 16:42:02.973482 24193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:02.973778 24193 log.cc:824] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:02.974512 24193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: No bootstrap required, opened a new log
I20260812 16:42:02.976374 24193 raft_consensus.cc:348] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80617551dc64aae9c59bf8d4b06da18" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43431 } }
I20260812 16:42:02.976548 24193 raft_consensus.cc:374] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:02.976598 24193 raft_consensus.cc:729] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80617551dc64aae9c59bf8d4b06da18, State: Initialized, Role: FOLLOWER
I20260812 16:42:02.976729 24193 consensus_queue.cc:260] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80617551dc64aae9c59bf8d4b06da18" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43431 } }
I20260812 16:42:02.976820 24193 raft_consensus.cc:388] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:02.976864 24193 raft_consensus.cc:482] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:02.976913 24193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:02.977521 24193 raft_consensus.cc:504] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80617551dc64aae9c59bf8d4b06da18" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43431 } }
I20260812 16:42:02.977641 24193 leader_election.cc:302] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b80617551dc64aae9c59bf8d4b06da18; no voters:
I20260812 16:42:02.977818 24193 leader_election.cc:288] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:02.977843 24207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:02.977954 24207 raft_consensus.cc:686] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [term 1 LEADER]: Becoming Leader. State: Replica: b80617551dc64aae9c59bf8d4b06da18, State: Running, Role: LEADER
I20260812 16:42:02.978039 24207 consensus_queue.cc:237] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80617551dc64aae9c59bf8d4b06da18" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43431 } }
I20260812 16:42:02.978084 24193 sys_catalog.cc:564] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:02.978405 24207 sys_catalog.cc:455] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b80617551dc64aae9c59bf8d4b06da18. Latest consensus state: current_term: 1 leader_uuid: "b80617551dc64aae9c59bf8d4b06da18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80617551dc64aae9c59bf8d4b06da18" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43431 } } }
I20260812 16:42:02.978493 24207 sys_catalog.cc:458] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:02.978440 24210 sys_catalog.cc:455] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b80617551dc64aae9c59bf8d4b06da18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80617551dc64aae9c59bf8d4b06da18" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43431 } } }
I20260812 16:42:02.978672 24210 sys_catalog.cc:458] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18 [sys.catalog]: This master's current role is: LEADER
Aug 12 16:42:02 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
W20260812 16:42:02.979893 24238 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:02.979955 24238 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:02.980165 24218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:02.980383 24218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:02.981868 24218 catalog_manager.cc:1347] Generated new cluster ID: e617948d94f546bd82d81506ad685d50
I20260812 16:42:02.981922 24218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:02.984575 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:02.972992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.21.114.126:43431)
0812 16:42:02.973184 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:02.973193 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:02.973219 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:42:02.973722 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:02.973730 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:02.973779 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:02.973959 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:02.974584 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:02.975504 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:02.976289 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:02.976810 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:02.976939 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:02.979903 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:02.979908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:02.979908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:02.979921 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:02.982396 (+ 2475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:02.982812 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:02.982815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:02.982816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:02.982936 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:02.983156 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:02.983157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:02.983157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:02.983460 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:02.983622 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:02.984176 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 16:42:02.984351 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260812 16:42:02.993290 24218 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:02.993814 24218 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:02.999303 24218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: Generated new TSK 0
I20260812 16:42:02.999501 24218 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:03.035101 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43431
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:03.147724 24247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:03.147938 24247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:03.147962 24247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:03.149151 24247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:03.149195 24247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:03.149216 24247 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:03.149235 24247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:03.150712 24247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:03.150972 24247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:03.151213 24247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:03.156399 24259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:03.156443 24253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:03.156489 24247 server_base.cc:1034] running on GCE node
W20260812 16:42:03.156399 24256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:03.156845 24247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:03.157094 24247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:03.158270 24247 hybrid_clock.cc:648] HybridClock initialized: now 1786552923158256 us; error 32 us; skew 500 ppm
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:03.160983 24247 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:03.161481 24247 webserver.cc:460] Webserver started at http://127.21.114.65:37129/ using document root <none> and password file <none>
I20260812 16:42:03.161695 24247 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:03.161746 24247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:03.161844 24247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:03.162861 24247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "995a2774332349a194d20b3f9cdc29b7"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "f2989adada1bd8f4f8096ee53ecbfd46"
server_key_iv: "5a4382ad8aa4f0f68510a6c5bd143e33"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.163180 24247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "995a2774332349a194d20b3f9cdc29b7"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "f2989adada1bd8f4f8096ee53ecbfd46"
server_key_iv: "5a4382ad8aa4f0f68510a6c5bd143e33"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.164539 24247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:03.165222 24274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.165405 24247 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:03.165515 24247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "995a2774332349a194d20b3f9cdc29b7"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "f2989adada1bd8f4f8096ee53ecbfd46"
server_key_iv: "5a4382ad8aa4f0f68510a6c5bd143e33"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.165589 24247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:03.190327 24247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:03.192747 24247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:03.192912 24247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:03.193462 24247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:03.193521 24247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.193564 24247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:03.193595 24247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:03.201315 24247 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:38111
I20260812 16:42:03.201756 24247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:03.202273 24506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:38111 every 8 connection(s)
I20260812 16:42:03.204432 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.194124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53267 (local address 127.21.114.126:43431)
0812 16:42:03.194218 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.194221 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.194483 (+ 262us) server_negotiation.cc:407] Connection header received
0812 16:42:03.195302 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.195303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.195318 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.195401 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.196392 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.196923 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.198661 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.198893 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.198984 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.201293 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.201295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.201295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.201304 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.202939 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.203385 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.203386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.203387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.203456 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.203718 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.203719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.203720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.203846 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.203916 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.204195 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.204336 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 16:42:03.204617 24291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.194093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.21.114.65:53267)
0812 16:42:03.194321 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.194376 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.195159 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.195511 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.195517 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.195944 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.196265 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.196272 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.197036 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.197037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.198552 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.198556 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.199008 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.199010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.199154 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.199695 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.199704 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.201197 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.203045 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.203053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.203055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.203289 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.203530 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.203531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.203531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.203648 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.203920 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.203928 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.204067 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.204174 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.204381 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":125,"threads_started":1}
I20260812 16:42:03.205106 24508 heartbeater.cc:347] Connected to a master server at 127.21.114.126:43431
I20260812 16:42:03.205188 24508 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:03.205384 24508 heartbeater.cc:511] Master 127.21.114.126:43431 requested a full tablet report, sending...
I20260812 16:42:03.205984 24093 ts_manager.cc:194] Registered new tserver with Master: 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65:38111)
I20260812 16:42:03.206919 24093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:53267
I20260812 16:42:03.211267 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.206258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:42527 (local address 127.21.114.126:43431)
0812 16:42:03.206300 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.206302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.206403 (+ 101us) server_negotiation.cc:407] Connection header received
0812 16:42:03.206459 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.206460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.206468 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.206510 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.206842 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.207495 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.208180 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.208425 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.208527 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.209319 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.209321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.209321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.209327 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.210428 (+ 1101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.210726 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.210727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.210727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.210777 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.210905 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.210906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.210906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.210996 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.211043 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.211153 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.211211 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:42:03.211274 24519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.206184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.21.114.65:42527)
0812 16:42:03.206325 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.206337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.206405 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.206523 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.206523 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.206719 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.206778 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.206779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.207589 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.207590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.208107 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.208109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.208534 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.208535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.208616 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.208971 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.208975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.209248 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.210499 (+ 1251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.210500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.210500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.210665 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.210818 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.210818 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.210818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.210862 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.211049 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.211050 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.211088 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.211139 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.211213 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260812 16:42:03.211884 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24247
I20260812 16:42:03.212001 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:03.212172 21961 external_mini_cluster.cc:1428] Setting key d8b2b0f0f031f2ded22344cf14e1d76c
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:03.238561 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43431
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:03.321637 24523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:03.321883 24523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:03.321933 24523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:03.323129 24523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:03.323192 24523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:03.323227 24523 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:03.323261 24523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:03.324751 24523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:03.325006 24523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:03.325248 24523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:03.330341 24537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:03.330384 24523 server_base.cc:1034] running on GCE node
W20260812 16:42:03.330364 24541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:03.330339 24533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:03.330864 24523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:03.331101 24523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:03.332267 24523 hybrid_clock.cc:648] HybridClock initialized: now 1786552923332253 us; error 27 us; skew 500 ppm
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:03.334803 24523 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:03.335201 24523 webserver.cc:460] Webserver started at http://127.21.114.66:35489/ using document root <none> and password file <none>
I20260812 16:42:03.335392 24523 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:03.335433 24523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:03.335530 24523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:03.336642 24523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "8cc7eb3d34024e01ae321d4ce1481080"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "ef085f93d96dc1a2e7611c44ec0be5c9"
server_key_iv: "9a03b4269cabf39adf152991be2afb90"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.336956 24523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "8cc7eb3d34024e01ae321d4ce1481080"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "ef085f93d96dc1a2e7611c44ec0be5c9"
server_key_iv: "9a03b4269cabf39adf152991be2afb90"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.338227 24523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:03.338938 24549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.339114 24523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:03.339200 24523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "8cc7eb3d34024e01ae321d4ce1481080"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "ef085f93d96dc1a2e7611c44ec0be5c9"
server_key_iv: "9a03b4269cabf39adf152991be2afb90"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.339255 24523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:03.355775 24523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:03.358156 24523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:03.358273 24523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:03.358744 24523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:03.358789 24523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.358814 24523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:03.358865 24523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.365629 24523 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:36229
I20260812 16:42:03.365702 24764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:36229 every 8 connection(s)
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:03.366019 24523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:03.369127 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.359280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:41417 (local address 127.21.114.126:43431)
0812 16:42:03.359348 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.359351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.359577 (+ 226us) server_negotiation.cc:407] Connection header received
0812 16:42:03.360078 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.360080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.360094 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.360182 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.361115 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.361987 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.363588 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.363916 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.364004 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.366557 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.366559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.366559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.366581 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.367812 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.368198 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.368199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.368199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.368254 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.368573 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.368573 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.368574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.368683 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.368736 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.368995 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.369062 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:03.369261 24570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.359257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.21.114.66:41417)
0812 16:42:03.359445 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.359485 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.359981 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.360265 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.360268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.360698 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.361003 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.361010 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.362089 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.362090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.363466 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.363470 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.364010 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.364011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.364114 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.364692 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.364704 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.366471 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.367901 (+ 1430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.367907 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.367909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.368132 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.368348 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.368348 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.368349 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.368512 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.368746 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.368752 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.368875 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.368955 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.369077 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":120,"threads_started":1}
I20260812 16:42:03.369767 24768 heartbeater.cc:347] Connected to a master server at 127.21.114.126:43431
I20260812 16:42:03.369861 24768 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:03.370061 24768 heartbeater.cc:511] Master 127.21.114.126:43431 requested a full tablet report, sending...
I20260812 16:42:03.370478 24095 ts_manager.cc:194] Registered new tserver with Master: 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229)
I20260812 16:42:03.370857 24095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:41417
I20260812 16:42:03.373903 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24523
I20260812 16:42:03.374019 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:03.374212 21961 external_mini_cluster.cc:1428] Setting key c52275b9f347eb88cd4b366ec621cfe3
I20260812 16:42:03.376405 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.370933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:53401 (local address 127.21.114.126:43431)
0812 16:42:03.370975 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.370977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.371049 (+ 72us) server_negotiation.cc:407] Connection header received
0812 16:42:03.371117 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.371118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.371129 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.371176 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.371502 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.371973 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.372708 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.372912 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.372985 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.373772 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.373773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.373773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.373780 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.375237 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.375568 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.375569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.375570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.375630 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.375824 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.375825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.375826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.375976 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.376055 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.376213 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.376290 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:42:03.376417 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.370877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.21.114.66:53401)
0812 16:42:03.370998 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.371009 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.371064 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.371179 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.371180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.371369 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.371426 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.371428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.372065 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.372066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.372629 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.372631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.372984 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.372985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.373060 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.373408 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.373412 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.373671 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.375325 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.375326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.375327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.375498 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.375700 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.375701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.375701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.375763 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.376046 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.376047 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.376096 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.376174 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.376284 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:03.400552 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43431
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:03.485054 24787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:03.485245 24787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:03.485270 24787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:03.486367 24787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:03.486400 24787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:03.486420 24787 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:03.486438 24787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:03.487756 24787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:03.487931 24787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:03.488101 24787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:03.493216 24787 server_base.cc:1034] running on GCE node
W20260812 16:42:03.493165 24803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:03.493177 24809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:03.493175 24798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:03.493610 24787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:03.493873 24787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:03.495044 24787 hybrid_clock.cc:648] HybridClock initialized: now 1786552923495026 us; error 36 us; skew 500 ppm
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:03.497622 24787 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:03.498100 24787 webserver.cc:460] Webserver started at http://127.21.114.67:36443/ using document root <none> and password file <none>
I20260812 16:42:03.498322 24787 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:03.498387 24787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:03.498538 24787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:03.499681 24787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "7571e29c61c546dda23be1c22491ca4e"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "72902d948d0d370aa20a5b2561b1d218"
server_key_iv: "0137183d05b74169495eb5b4064801e1"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.500109 24787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "7571e29c61c546dda23be1c22491ca4e"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "72902d948d0d370aa20a5b2561b1d218"
server_key_iv: "0137183d05b74169495eb5b4064801e1"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.501511 24787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:03.502261 24822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.502437 24787 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.502537 24787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "7571e29c61c546dda23be1c22491ca4e"
format_stamp: "Formatted at 2026-08-12 16:42:03 on dist-test-slave-45dx"
server_key: "72902d948d0d370aa20a5b2561b1d218"
server_key_iv: "0137183d05b74169495eb5b4064801e1"
server_key_version: "encryptionkey@0"
I20260812 16:42:03.502615 24787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:03.522214 24787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:03.524595 24787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:03.524758 24787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:03.525323 24787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:03.525382 24787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.525441 24787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:03.525468 24787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:03.532889 24787 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:35325
I20260812 16:42:03.532963 25040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:35325 every 8 connection(s)
I20260812 16:42:03.533269 24787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:03.535791 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.525741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:42531 (local address 127.21.114.126:43431)
0812 16:42:03.525795 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.525797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.526061 (+ 264us) server_negotiation.cc:407] Connection header received
0812 16:42:03.526544 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.526546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.526561 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.526644 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.527622 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.528507 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.529618 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.529889 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.529953 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.532854 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.532856 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.532856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.532865 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.534418 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.534823 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.534825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.534825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.534886 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.535143 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.535144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.535145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.535266 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.535337 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.535614 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.535696 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:42:03.535831 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24787
I20260812 16:42:03.535945 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:03.535993 24841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.525742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.21.114.67:42531)
0812 16:42:03.525919 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.525961 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.526447 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.526847 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.526852 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.527192 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.527506 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.527513 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.528613 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.528615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.529510 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.529512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.529976 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.529977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.530122 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.530689 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.530699 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.532762 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.534512 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.534519 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.534521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.534748 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.534968 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.534968 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.534969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.535079 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.535339 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.535346 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.535485 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.535591 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.535750 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":109,"threads_started":1}
I20260812 16:42:03.536109 21961 external_mini_cluster.cc:1428] Setting key 58ba07bea7271d208820710f4b9bf832
I20260812 16:42:03.536592 25043 heartbeater.cc:347] Connected to a master server at 127.21.114.126:43431
I20260812 16:42:03.536676 25043 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:03.536866 25043 heartbeater.cc:511] Master 127.21.114.126:43431 requested a full tablet report, sending...
I20260812 16:42:03.537247 24092 ts_manager.cc:194] Registered new tserver with Master: 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.537766 24092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:42531
I20260812 16:42:03.542697 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.537586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.21.114.67:40915)
0812 16:42:03.537708 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.537719 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.537780 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.537898 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.537899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.538058 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.538117 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.538118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.538756 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.538757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.539238 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.539239 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.539562 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.539563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.539620 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.539998 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.540002 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.540265 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.541819 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.541819 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.541820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.542041 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.542210 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.542211 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.542211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.542265 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.542446 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.542447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.542482 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.542532 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.542624 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
I20260812 16:42:03.542697 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.537650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:40915 (local address 127.21.114.126:43431)
0812 16:42:03.537696 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.537698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.537770 (+ 72us) server_negotiation.cc:407] Connection header received
0812 16:42:03.537820 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.537821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.537831 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.537896 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.538214 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.538668 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.539308 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.539496 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.539552 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.540384 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.540385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.540389 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.540396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.541746 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.542100 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.542100 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.542101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.542153 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.542303 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.542303 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.542303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.542400 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.542446 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.542548 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.542603 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:03.547960 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:03.572700 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.565562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33250 (local address 127.21.114.126:43431)
0812 16:42:03.565630 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.565632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.565641 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:03.565700 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.565702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.565710 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.565785 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.566428 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.566932 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.567632 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.567890 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.567988 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.570329 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.570330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.570330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.570338 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.571712 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.572032 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.572032 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.572033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.572085 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.572245 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.572245 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.572245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.572394 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.572475 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.572549 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.572605 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:42:03.574221 24092 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:03.575799 24092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:03.582587 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.578309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52750 (local address 127.21.114.66:36229)
0812 16:42:03.578937 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.578941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.578950 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:03.578989 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.578991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.579005 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.579080 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.579277 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.580450 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.581645 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.582172 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.582262 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.582326 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.582451 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.582492 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":78,"threads_started":1}
I20260812 16:42:03.582579 25075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.578172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36229 (local address 127.0.0.1:52750)
0812 16:42:03.578485 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.578496 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.578539 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.579153 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.579154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.579156 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.579201 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.579202 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.580550 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.580551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.581565 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.581567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.582261 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.582262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.582344 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.582358 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.582436 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.582489 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":99,"threads_started":1}
I20260812 16:42:03.582831 25077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.578181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:35325 (local address 127.0.0.1:37182)
0812 16:42:03.578597 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.578605 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.578637 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.578847 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.578850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.578853 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.578935 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.578937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.579942 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.579943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.581397 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.581400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.582420 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.582421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.582484 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.582490 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.582541 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.582588 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":102,"threads_started":1}
I20260812 16:42:03.582832 25079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.578445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37182 (local address 127.21.114.67:35325)
0812 16:42:03.578632 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.578638 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.578650 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:42:03.578699 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.578702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.578718 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.578814 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.579003 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.579857 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.581498 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.582247 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.582316 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.582381 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.582637 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.582709 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260812 16:42:03.583330 24646 tablet_service.cc:1467] Processing CreateTablet for tablet a5969a886d1340b1b5db1a992d98eeb4 (DEFAULT_TABLE table=test-table [id=40ed19e96e664174905c3db288304b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:03.583534 24907 tablet_service.cc:1467] Processing CreateTablet for tablet a5969a886d1340b1b5db1a992d98eeb4 (DEFAULT_TABLE table=test-table [id=40ed19e96e664174905c3db288304b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:03.583693 25076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.578157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:38111 (local address 127.0.0.1:55448)
0812 16:42:03.578359 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.578405 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.578486 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.579322 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.579323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.579325 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.579374 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.579376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.580775 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.580776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.581779 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.581783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.583435 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.583436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.583547 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.583552 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.583589 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.583628 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":60,"threads_started":1}
I20260812 16:42:03.583741 24646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5969a886d1340b1b5db1a992d98eeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.583909 24907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5969a886d1340b1b5db1a992d98eeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.584257 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.578473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55448 (local address 127.21.114.65:38111)
0812 16:42:03.578674 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.578678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.578688 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:03.578722 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.578724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.578738 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.579490 (+ 752us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.579563 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.580674 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.581888 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.582592 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.584011 (+ 1419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.584078 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.584105 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.584146 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":80,"threads_started":1}
I20260812 16:42:03.585018 24358 tablet_service.cc:1467] Processing CreateTablet for tablet a5969a886d1340b1b5db1a992d98eeb4 (DEFAULT_TABLE table=test-table [id=40ed19e96e664174905c3db288304b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:03.585373 24358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5969a886d1340b1b5db1a992d98eeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.586812 25082 tablet_bootstrap.cc:492] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Bootstrap starting.
I20260812 16:42:03.587495 25083 tablet_bootstrap.cc:492] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Bootstrap starting.
I20260812 16:42:03.587761 25082 tablet_bootstrap.cc:654] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.588146 25082 log.cc:824] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:03.588217 25083 tablet_bootstrap.cc:654] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.588625 25083 log.cc:824] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:03.589042 25082 tablet_bootstrap.cc:492] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: No bootstrap required, opened a new log
I20260812 16:42:03.589161 25086 tablet_bootstrap.cc:492] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Bootstrap starting.
I20260812 16:42:03.589298 25082 ts_tablet_manager.cc:1397] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:42:03.589502 25083 tablet_bootstrap.cc:492] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: No bootstrap required, opened a new log
I20260812 16:42:03.589581 25083 ts_tablet_manager.cc:1397] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 16:42:03.590133 25086 tablet_bootstrap.cc:654] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.590504 25086 log.cc:824] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:03.591305 25086 tablet_bootstrap.cc:492] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: No bootstrap required, opened a new log
I20260812 16:42:03.591244 25083 raft_consensus.cc:348] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.591388 25086 ts_tablet_manager.cc:1397] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:03.591390 25083 raft_consensus.cc:374] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.591444 25083 raft_consensus.cc:729] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc7eb3d34024e01ae321d4ce1481080, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.591480 25082 raft_consensus.cc:348] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.591553 25083 consensus_queue.cc:260] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.591637 25082 raft_consensus.cc:374] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.591679 25082 raft_consensus.cc:729] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7571e29c61c546dda23be1c22491ca4e, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.591786 25082 consensus_queue.cc:260] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.591832 25083 ts_tablet_manager.cc:1428] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 16:42:03.591845 24768 heartbeater.cc:503] Master 127.21.114.126:43431 was elected leader, sending a full tablet report...
I20260812 16:42:03.592077 25082 ts_tablet_manager.cc:1428] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:03.592101 25043 heartbeater.cc:503] Master 127.21.114.126:43431 was elected leader, sending a full tablet report...
I20260812 16:42:03.593568 25086 raft_consensus.cc:348] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.593693 25086 raft_consensus.cc:374] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.593713 25086 raft_consensus.cc:729] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995a2774332349a194d20b3f9cdc29b7, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.593842 25086 consensus_queue.cc:260] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.594081 25086 ts_tablet_manager.cc:1428] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:03.594115 24508 heartbeater.cc:503] Master 127.21.114.126:43431 was elected leader, sending a full tablet report...
W20260812 16:42:03.616677 24770 tablet.cc:2369] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:03.622201 25099 raft_consensus.cc:482] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:03.622313 25099 raft_consensus.cc:504] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.622627 25099 leader_election.cc:288] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229), 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.625437 24291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.622827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36229 (local address 127.21.114.65:40331)
0812 16:42:03.622873 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.622886 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.622929 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.623112 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.623113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.623115 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.623190 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.623191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.623835 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.623836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.624630 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.624632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.625162 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.625163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.625250 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.625253 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.625318 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.625358 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":1}
I20260812 16:42:03.625437 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.622910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:40331 (local address 127.21.114.66:36229)
0812 16:42:03.622959 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.622962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.622971 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:03.623001 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.623003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.623013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.623102 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.623265 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.623743 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.624725 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.625080 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.625164 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.625173 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.625325 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.625362 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:42:03.625592 25079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.622959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:36013 (local address 127.21.114.67:35325)
0812 16:42:03.623001 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.623003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.623112 (+ 109us) server_negotiation.cc:407] Connection header received
0812 16:42:03.623166 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.623168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.623178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.623249 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.623417 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.623895 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.624871 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.625242 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.625326 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.625335 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.625487 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.625525 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:03.625617 25100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.622827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:35325 (local address 127.21.114.65:36013)
0812 16:42:03.623032 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.623040 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.623110 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.623255 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.623256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.623257 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.623338 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.623347 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.623982 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.623984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.624783 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.624786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.625326 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.625327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.625414 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.625418 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.625481 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.625520 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":56,"thread_start_us":112,"threads_started":1}
I20260812 16:42:03.625808 24677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5969a886d1340b1b5db1a992d98eeb4" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc7eb3d34024e01ae321d4ce1481080" is_pre_election: true
I20260812 16:42:03.625982 24677 raft_consensus.cc:2454] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 0.
I20260812 16:42:03.625974 24952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5969a886d1340b1b5db1a992d98eeb4" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7571e29c61c546dda23be1c22491ca4e" is_pre_election: true
I20260812 16:42:03.626104 24952 raft_consensus.cc:2454] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 0.
I20260812 16:42:03.626235 24276 leader_election.cc:302] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cc7eb3d34024e01ae321d4ce1481080, 995a2774332349a194d20b3f9cdc29b7; no voters:
I20260812 16:42:03.626362 25099 raft_consensus.cc:2781] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:03.626449 25099 raft_consensus.cc:482] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:03.626500 25099 raft_consensus.cc:3037] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.627456 25099 raft_consensus.cc:504] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.627607 25099 leader_election.cc:288] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229), 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.627771 24952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5969a886d1340b1b5db1a992d98eeb4" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7571e29c61c546dda23be1c22491ca4e"
I20260812 16:42:03.627777 24677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5969a886d1340b1b5db1a992d98eeb4" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc7eb3d34024e01ae321d4ce1481080"
I20260812 16:42:03.627868 24677 raft_consensus.cc:3037] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.627871 24952 raft_consensus.cc:3037] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.628655 24677 raft_consensus.cc:2454] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 1.
I20260812 16:42:03.628728 24952 raft_consensus.cc:2454] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 1.
I20260812 16:42:03.628862 24276 leader_election.cc:302] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cc7eb3d34024e01ae321d4ce1481080, 995a2774332349a194d20b3f9cdc29b7; no voters:
I20260812 16:42:03.628968 25099 raft_consensus.cc:2781] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:03.629113 25099 raft_consensus.cc:686] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 1 LEADER]: Becoming Leader. State: Replica: 995a2774332349a194d20b3f9cdc29b7, State: Running, Role: LEADER
I20260812 16:42:03.629215 25099 consensus_queue.cc:237] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.630014 24095 catalog_manager.cc:5495] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "995a2774332349a194d20b3f9cdc29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:03.643831 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.641186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55454 (local address 127.21.114.65:38111)
0812 16:42:03.641255 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.641258 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.641268 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:03.641350 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.641351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.641372 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.641436 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:03.641609 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.642165 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.642971 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.643166 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.643238 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.643457 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:03.643553 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:03.643640 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.643695 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.643718 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 16:42:03.645574 24952 raft_consensus.cc:1261] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Refusing update from remote peer 995a2774332349a194d20b3f9cdc29b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:03.645591 24677 raft_consensus.cc:1261] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Refusing update from remote peer 995a2774332349a194d20b3f9cdc29b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:03.645931 25099 consensus_queue.cc:1035] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:03.646077 25112 consensus_queue.cc:1035] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:03.649129 25119 mvcc.cc:205] Tried to move back new op lower bound from 7317720775249719296 to 7317720775185899520. Current Snapshot: MvccSnapshot[applied={T|T < 7317720775249719296}]
I20260812 16:42:03.652254 24095 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:03.652388 24095 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:03.653167 24095 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: Sending DeleteTablet for 3 replicas of tablet a5969a886d1340b1b5db1a992d98eeb4
I20260812 16:42:03.653524 24358 tablet_service.cc:1514] Processing DeleteTablet for tablet a5969a886d1340b1b5db1a992d98eeb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:03 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:55448
I20260812 16:42:03.653532 24907 tablet_service.cc:1514] Processing DeleteTablet for tablet a5969a886d1340b1b5db1a992d98eeb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:03 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:37182
I20260812 16:42:03.653527 24646 tablet_service.cc:1514] Processing DeleteTablet for tablet a5969a886d1340b1b5db1a992d98eeb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:03 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52750
I20260812 16:42:03.653844 25148 tablet_replica.cc:330] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: stopping tablet replica
I20260812 16:42:03.654042 25148 raft_consensus.cc:2229] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:03.654054 24095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 16:42:03.654174 25148 raft_consensus.cc:2258] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 16:42:03.654178 24095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:03.654575 25144 tablet_replica.cc:330] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: stopping tablet replica
I20260812 16:42:03.654680 25144 raft_consensus.cc:2229] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:03.654680 25148 ts_tablet_manager.cc:1905] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:03.654786 25144 raft_consensus.cc:2258] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:03.655205 25144 ts_tablet_manager.cc:1905] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:03.655858 24358 tablet_service.cc:1467] Processing CreateTablet for tablet 5b12c5ad7e4947e18198575978db00f7 (DEFAULT_TABLE table=test-table [id=4a4212b28f4447c99a31da9543ac622d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:03.655987 24358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b12c5ad7e4947e18198575978db00f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.656388 25148 ts_tablet_manager.cc:1918] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:03.656461 25148 log.cc:1196] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/a5969a886d1340b1b5db1a992d98eeb4
I20260812 16:42:03.656725 25148 ts_tablet_manager.cc:1939] T a5969a886d1340b1b5db1a992d98eeb4 P 995a2774332349a194d20b3f9cdc29b7: Deleting consensus metadata
I20260812 16:42:03.656905 25144 ts_tablet_manager.cc:1918] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:03.656968 25144 log.cc:1196] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/a5969a886d1340b1b5db1a992d98eeb4
I20260812 16:42:03.657222 25144 ts_tablet_manager.cc:1939] T a5969a886d1340b1b5db1a992d98eeb4 P 8cc7eb3d34024e01ae321d4ce1481080: Deleting consensus metadata
I20260812 16:42:03.657354 25086 tablet_bootstrap.cc:492] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Bootstrap starting.
I20260812 16:42:03.657631 25145 tablet_replica.cc:330] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: stopping tablet replica
I20260812 16:42:03.657730 25145 raft_consensus.cc:2229] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:03.657789 25086 tablet_bootstrap.cc:654] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.657891 25145 raft_consensus.cc:2258] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:03.658222 24069 catalog_manager.cc:4841] TS 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65:38111): tablet a5969a886d1340b1b5db1a992d98eeb4 (table test-table [id=40ed19e96e664174905c3db288304b8d]) successfully deleted
I20260812 16:42:03.658390 25145 ts_tablet_manager.cc:1905] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:03.658396 24063 catalog_manager.cc:4841] TS 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229): tablet a5969a886d1340b1b5db1a992d98eeb4 (table test-table [id=40ed19e96e664174905c3db288304b8d]) successfully deleted
I20260812 16:42:03.658434 25086 tablet_bootstrap.cc:492] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: No bootstrap required, opened a new log
I20260812 16:42:03.658478 25086 ts_tablet_manager.cc:1397] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:03.658566 24646 tablet_service.cc:1467] Processing CreateTablet for tablet 5b12c5ad7e4947e18198575978db00f7 (DEFAULT_TABLE table=test-table [id=4a4212b28f4447c99a31da9543ac622d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:03.658613 25086 raft_consensus.cc:348] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.658659 24646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b12c5ad7e4947e18198575978db00f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.658677 25086 raft_consensus.cc:374] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.658700 25086 raft_consensus.cc:729] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995a2774332349a194d20b3f9cdc29b7, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.658753 25086 consensus_queue.cc:260] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.658846 25086 ts_tablet_manager.cc:1428] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:03.659909 25083 tablet_bootstrap.cc:492] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Bootstrap starting.
I20260812 16:42:03.660156 24907 tablet_service.cc:1467] Processing CreateTablet for tablet 5b12c5ad7e4947e18198575978db00f7 (DEFAULT_TABLE table=test-table [id=4a4212b28f4447c99a31da9543ac622d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:03.660264 24907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b12c5ad7e4947e18198575978db00f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.660368 25083 tablet_bootstrap.cc:654] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.661302 25083 tablet_bootstrap.cc:492] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: No bootstrap required, opened a new log
I20260812 16:42:03.661353 25083 ts_tablet_manager.cc:1397] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:03.661510 25083 raft_consensus.cc:348] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.661583 25083 raft_consensus.cc:374] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.661604 25083 raft_consensus.cc:729] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc7eb3d34024e01ae321d4ce1481080, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.661602 25082 tablet_bootstrap.cc:492] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Bootstrap starting.
I20260812 16:42:03.661653 25083 consensus_queue.cc:260] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.661608 25145 ts_tablet_manager.cc:1918] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:03.661752 25145 log.cc:1196] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/a5969a886d1340b1b5db1a992d98eeb4
I20260812 16:42:03.661764 25083 ts_tablet_manager.cc:1428] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.662063 25082 tablet_bootstrap.cc:654] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.662091 25145 ts_tablet_manager.cc:1939] T a5969a886d1340b1b5db1a992d98eeb4 P 7571e29c61c546dda23be1c22491ca4e: Deleting consensus metadata
I20260812 16:42:03.662567 24067 catalog_manager.cc:4841] TS 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325): tablet a5969a886d1340b1b5db1a992d98eeb4 (table test-table [id=40ed19e96e664174905c3db288304b8d]) successfully deleted
I20260812 16:42:03.662927 25082 tablet_bootstrap.cc:492] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: No bootstrap required, opened a new log
I20260812 16:42:03.662981 25082 ts_tablet_manager.cc:1397] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:03.663122 25082 raft_consensus.cc:348] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.663197 25082 raft_consensus.cc:374] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.663218 25082 raft_consensus.cc:729] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7571e29c61c546dda23be1c22491ca4e, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.663268 25082 consensus_queue.cc:260] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.663352 25082 ts_tablet_manager.cc:1428] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260812 16:42:03.702567 24509 tablet.cc:2369] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:03.784193 25044 tablet.cc:2369] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:03.793545 25099 raft_consensus.cc:482] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:03.793653 25099 raft_consensus.cc:504] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.793838 25099 leader_election.cc:288] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229), 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.794119 24677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b12c5ad7e4947e18198575978db00f7" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc7eb3d34024e01ae321d4ce1481080" is_pre_election: true
I20260812 16:42:03.794119 24952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b12c5ad7e4947e18198575978db00f7" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7571e29c61c546dda23be1c22491ca4e" is_pre_election: true
I20260812 16:42:03.794224 24952 raft_consensus.cc:2454] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 0.
I20260812 16:42:03.794224 24677 raft_consensus.cc:2454] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 0.
I20260812 16:42:03.794428 24281 leader_election.cc:302] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7571e29c61c546dda23be1c22491ca4e, 995a2774332349a194d20b3f9cdc29b7; no voters:
I20260812 16:42:03.794575 25099 raft_consensus.cc:2781] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:03.794663 25099 raft_consensus.cc:482] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:03.794696 25099 raft_consensus.cc:3037] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.795392 25099 raft_consensus.cc:504] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.795549 25099 leader_election.cc:288] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 election: Requested vote from peers 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229), 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.795712 24677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b12c5ad7e4947e18198575978db00f7" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc7eb3d34024e01ae321d4ce1481080"
I20260812 16:42:03.795805 24677 raft_consensus.cc:3037] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.795746 24952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b12c5ad7e4947e18198575978db00f7" candidate_uuid: "995a2774332349a194d20b3f9cdc29b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7571e29c61c546dda23be1c22491ca4e"
I20260812 16:42:03.795852 24952 raft_consensus.cc:3037] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.796545 24677 raft_consensus.cc:2454] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 1.
I20260812 16:42:03.796576 24952 raft_consensus.cc:2454] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 995a2774332349a194d20b3f9cdc29b7 in term 1.
I20260812 16:42:03.796720 24276 leader_election.cc:302] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cc7eb3d34024e01ae321d4ce1481080, 995a2774332349a194d20b3f9cdc29b7; no voters:
I20260812 16:42:03.796833 25099 raft_consensus.cc:2781] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:03.796896 25099 raft_consensus.cc:686] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 1 LEADER]: Becoming Leader. State: Replica: 995a2774332349a194d20b3f9cdc29b7, State: Running, Role: LEADER
I20260812 16:42:03.796962 25099 consensus_queue.cc:237] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.797628 24095 catalog_manager.cc:5495] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "995a2774332349a194d20b3f9cdc29b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } health_report { overall_health: UNKNOWN } } }
Aug 12 16:42:03 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552922, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:03.832089 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.825068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43431 (local address 127.0.0.1:33260)
0812 16:42:03.825243 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.825254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.825343 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.825484 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.825485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.825832 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:03.825894 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.825896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.826572 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.826574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.827099 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.827100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.827448 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.827449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.827501 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.828026 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:03.828031 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:03.829473 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:03.831083 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.831091 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.831093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.831286 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.831523 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:03.831524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:03.831524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:03.831586 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:03.831791 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:03.831797 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:03.831847 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.831899 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.831992 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":82,"threads_started":1}
I20260812 16:42:03.832137 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.825144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.21.114.126:43431)
0812 16:42:03.825209 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.825212 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.825326 (+ 114us) server_negotiation.cc:407] Connection header received
0812 16:42:03.825407 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.825408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.825419 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.825478 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:03.825984 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.826488 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.827184 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.827376 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.827450 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.829577 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:03.829579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:03.829579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:03.829586 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:03.831010 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.831408 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.831409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.831409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.831466 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:03.831638 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:03.831639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:03.831639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:03.831741 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:03.831790 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.831930 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.832040 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":34}
I20260812 16:42:03.834121 24095 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:33260:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 16:42:03.834306 24095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:03.835669 24646 tablet_service.cc:1467] Processing CreateTablet for tablet baa40e08dfbb439eba63fb0780aa029b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a557c12452a74b1cbe958e118d8fb0d3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:03.835698 24907 tablet_service.cc:1467] Processing CreateTablet for tablet baa40e08dfbb439eba63fb0780aa029b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a557c12452a74b1cbe958e118d8fb0d3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:03.835692 24358 tablet_service.cc:1467] Processing CreateTablet for tablet baa40e08dfbb439eba63fb0780aa029b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a557c12452a74b1cbe958e118d8fb0d3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:03.835848 24646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa40e08dfbb439eba63fb0780aa029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.835847 24907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa40e08dfbb439eba63fb0780aa029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.835865 24358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa40e08dfbb439eba63fb0780aa029b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:03.837370 25086 tablet_bootstrap.cc:492] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: Bootstrap starting.
I20260812 16:42:03.837426 25082 tablet_bootstrap.cc:492] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: Bootstrap starting.
I20260812 16:42:03.837424 25083 tablet_bootstrap.cc:492] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: Bootstrap starting.
I20260812 16:42:03.837704 25086 tablet_bootstrap.cc:654] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.837874 25083 tablet_bootstrap.cc:654] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.837874 25082 tablet_bootstrap.cc:654] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:03.838625 25083 tablet_bootstrap.cc:492] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: No bootstrap required, opened a new log
I20260812 16:42:03.838688 25083 ts_tablet_manager.cc:1397] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:03.838752 25086 tablet_bootstrap.cc:492] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: No bootstrap required, opened a new log
I20260812 16:42:03.838807 25082 tablet_bootstrap.cc:492] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: No bootstrap required, opened a new log
I20260812 16:42:03.838801 25086 ts_tablet_manager.cc:1397] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:03.838845 25082 ts_tablet_manager.cc:1397] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:03.838871 25083 raft_consensus.cc:348] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.838956 25083 raft_consensus.cc:374] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.838975 25083 raft_consensus.cc:729] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc7eb3d34024e01ae321d4ce1481080, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.838956 25086 raft_consensus.cc:348] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.839028 25086 raft_consensus.cc:374] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.838989 25082 raft_consensus.cc:348] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.839051 25086 raft_consensus.cc:729] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995a2774332349a194d20b3f9cdc29b7, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.839052 25082 raft_consensus.cc:374] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:03.839038 25083 consensus_queue.cc:260] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.839074 25082 raft_consensus.cc:729] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7571e29c61c546dda23be1c22491ca4e, State: Initialized, Role: FOLLOWER
I20260812 16:42:03.839102 25086 consensus_queue.cc:260] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.839116 25082 consensus_queue.cc:260] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.839135 25083 ts_tablet_manager.cc:1428] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:03.839195 25082 ts_tablet_manager.cc:1428] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:03.839195 25086 ts_tablet_manager.cc:1428] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:03.839224 25099 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.839257 25095 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.839318 25095 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.839315 25099 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.839321 25098 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.839392 25098 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.962718 25095 raft_consensus.cc:482] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:03.962822 25095 raft_consensus.cc:504] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.963178 25095 leader_election.cc:288] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65:38111), 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.967345 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.963505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:52309 (local address 127.21.114.65:38111)
0812 16:42:03.963554 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.963556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.963632 (+ 76us) server_negotiation.cc:407] Connection header received
0812 16:42:03.963706 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.963707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.963721 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.963769 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.963983 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.964762 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.966426 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.966988 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.967056 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.967065 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.967227 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.967269 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:03.967345 25079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.963449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:45865 (local address 127.21.114.67:35325)
0812 16:42:03.963503 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.963505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.963621 (+ 116us) server_negotiation.cc:407] Connection header received
0812 16:42:03.963683 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.963684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.963696 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.963762 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:03.964136 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.964842 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.966426 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.966977 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.967056 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.967065 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.967228 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.967268 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 16:42:03.967399 25176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.963387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:38111 (local address 127.21.114.66:52309)
0812 16:42:03.963554 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.963565 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.963622 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.963821 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.963822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.963824 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.963901 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.963903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.964869 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.964870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.966316 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.966320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.967066 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.967066 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.967147 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.967153 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.967212 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.967267 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":110,"thread_start_us":106,"threads_started":1}
I20260812 16:42:03.967402 25177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.963379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:35325 (local address 127.21.114.66:45865)
0812 16:42:03.963533 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.963544 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.963617 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.963985 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.963986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.963989 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:03.964064 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.964065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.964909 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.964910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.966316 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.966320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.967065 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.967066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.967147 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.967152 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.967212 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.967267 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":86,"thread_start_us":74,"threads_started":1}
I20260812 16:42:03.967728 24413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa40e08dfbb439eba63fb0780aa029b" candidate_uuid: "8cc7eb3d34024e01ae321d4ce1481080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "995a2774332349a194d20b3f9cdc29b7" is_pre_election: true
I20260812 16:42:03.967865 24413 raft_consensus.cc:2454] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cc7eb3d34024e01ae321d4ce1481080 in term 0.
I20260812 16:42:03.967892 24952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa40e08dfbb439eba63fb0780aa029b" candidate_uuid: "8cc7eb3d34024e01ae321d4ce1481080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7571e29c61c546dda23be1c22491ca4e" is_pre_election: true
I20260812 16:42:03.968014 24952 raft_consensus.cc:2454] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cc7eb3d34024e01ae321d4ce1481080 in term 0.
I20260812 16:42:03.968084 24561 leader_election.cc:302] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cc7eb3d34024e01ae321d4ce1481080, 995a2774332349a194d20b3f9cdc29b7; no voters:
I20260812 16:42:03.968227 25095 raft_consensus.cc:2781] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:03.968266 25095 raft_consensus.cc:482] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:03.968281 25095 raft_consensus.cc:3037] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.969168 25095 raft_consensus.cc:504] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.969321 25095 leader_election.cc:288] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [CANDIDATE]: Term 1 election: Requested vote from peers 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65:38111), 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325)
I20260812 16:42:03.969491 24952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa40e08dfbb439eba63fb0780aa029b" candidate_uuid: "8cc7eb3d34024e01ae321d4ce1481080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7571e29c61c546dda23be1c22491ca4e"
I20260812 16:42:03.969586 24952 raft_consensus.cc:3037] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.969548 24413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa40e08dfbb439eba63fb0780aa029b" candidate_uuid: "8cc7eb3d34024e01ae321d4ce1481080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "995a2774332349a194d20b3f9cdc29b7"
I20260812 16:42:03.969627 24413 raft_consensus.cc:3037] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:03.970150 24952 raft_consensus.cc:2454] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cc7eb3d34024e01ae321d4ce1481080 in term 1.
I20260812 16:42:03.970356 24559 leader_election.cc:302] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7571e29c61c546dda23be1c22491ca4e, 8cc7eb3d34024e01ae321d4ce1481080; no voters:
I20260812 16:42:03.970463 25095 raft_consensus.cc:2781] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:03.970585 24413 raft_consensus.cc:2454] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cc7eb3d34024e01ae321d4ce1481080 in term 1.
I20260812 16:42:03.970580 25095 raft_consensus.cc:686] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 LEADER]: Becoming Leader. State: Replica: 8cc7eb3d34024e01ae321d4ce1481080, State: Running, Role: LEADER
I20260812 16:42:03.970678 25095 consensus_queue.cc:237] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } }
I20260812 16:42:03.971161 25178 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: TxnStatusTablet state changed. Reason: New leader 8cc7eb3d34024e01ae321d4ce1481080. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.971295 25178 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:03.971365 24093 catalog_manager.cc:5495] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:03.971869 25182 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 16:42:03.971999 25182 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 16:42:03.987860 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.984929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52754 (local address 127.21.114.66:36229)
0812 16:42:03.984990 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.984992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.985069 (+ 77us) server_negotiation.cc:407] Connection header received
0812 16:42:03.985177 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.985177 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.985193 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.985251 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:03.985464 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.985996 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.987121 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.987308 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.987365 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.987567 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:03.987661 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:03.987709 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.987789 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.987807 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:42:03.987915 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.984852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36229 (local address 127.0.0.1:52754)
0812 16:42:03.985011 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.985024 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.985094 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.985327 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.985328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.985330 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:03.985386 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.985388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.986090 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.986091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.987032 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.987035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.987382 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.987384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.987454 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.987472 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:03.987718 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:03.987727 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.987779 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.987835 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260812 16:42:03.989308 24952 raft_consensus.cc:1261] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Refusing update from remote peer 8cc7eb3d34024e01ae321d4ce1481080: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:03.989342 24413 raft_consensus.cc:1261] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Refusing update from remote peer 8cc7eb3d34024e01ae321d4ce1481080: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:03.989650 25178 consensus_queue.cc:1035] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:03.989807 25095 consensus_queue.cc:1035] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:03.990473 25099 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: TxnStatusTablet state changed. Reason: New leader 8cc7eb3d34024e01ae321d4ce1481080. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.990568 25099 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.990551 25098 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: TxnStatusTablet state changed. Reason: New leader 8cc7eb3d34024e01ae321d4ce1481080. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.990677 25098 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.991302 25095 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.991395 25095 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:03.991802 25098 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.991894 25098 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 7571e29c61c546dda23be1c22491ca4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.993304 25095 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.993391 25095 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 8cc7eb3d34024e01ae321d4ce1481080: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:03.993400 25117 mvcc.cc:205] Tried to move back new op lower bound from 7317720776658075648 to 7317720776584564736. Current Snapshot: MvccSnapshot[applied={T|T < 7317720776658075648}]
I20260812 16:42:03.993467 25099 tablet_replica.cc:439] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8cc7eb3d34024e01ae321d4ce1481080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "995a2774332349a194d20b3f9cdc29b7" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 38111 } } peers { permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 } } peers { permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 } } }
I20260812 16:42:03.993537 25099 tablet_replica.cc:442] T baa40e08dfbb439eba63fb0780aa029b P 995a2774332349a194d20b3f9cdc29b7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:03.998950 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.995522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36229 (local address 127.21.114.65:32893)
0812 16:42:03.995706 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:03.995716 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:03.995775 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:03.995890 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:03.995891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:03.995892 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:03.995931 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.995932 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.996818 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.996819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.997900 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:03.997903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.998440 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.998441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:03.998490 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.998505 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:03.998789 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:03.998791 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:03.998846 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 16:42:03.998891 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":78,"threads_started":1}
I20260812 16:42:03.998966 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:03.995583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:32893 (local address 127.21.114.66:36229)
0812 16:42:03.995624 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:03.995626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:03.995780 (+ 154us) server_negotiation.cc:407] Connection header received
0812 16:42:03.995811 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:03.995812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:03.995823 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:03.995889 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:03.995967 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.996728 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.998026 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:03.998337 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:03.998418 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:03.998607 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:03.998642 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:03.998700 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:03.998872 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 16:42:03.998894 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:42:04.001199 24677 raft_consensus.cc:1261] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Refusing update from remote peer 995a2774332349a194d20b3f9cdc29b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:04.001219 24952 raft_consensus.cc:1261] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Refusing update from remote peer 995a2774332349a194d20b3f9cdc29b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:04.001441 25130 consensus_queue.cc:1035] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cc7eb3d34024e01ae321d4ce1481080" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:04.001536 25099 consensus_queue.cc:1035] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7571e29c61c546dda23be1c22491ca4e" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 35325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:04.003057 25125 mvcc.cc:205] Tried to move back new op lower bound from 7317720776707403776 to 7317720775872880640. Current Snapshot: MvccSnapshot[applied={T|T < 7317720776707403776}]
I20260812 16:42:04.011931 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:04.008822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:36509 (local address 127.21.114.65:38111)
0812 16:42:04.008863 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:04.008865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:04.009019 (+ 154us) server_negotiation.cc:407] Connection header received
0812 16:42:04.009049 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:04.009049 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:04.009061 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:04.009123 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:04.009273 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.010047 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.011283 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.011482 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.011539 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:04.011728 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:04.011757 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:04.011804 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:04.011862 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 16:42:04.011881 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:04.012003 25210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:04.008739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:38111 (local address 127.21.114.66:36509)
0812 16:42:04.008942 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:04.008952 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:04.009006 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:04.009125 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:04.009125 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:04.009126 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:04.009199 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:04.009200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.010145 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.010147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:04.011182 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:04.011185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.011557 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.011558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:04.011627 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:04.011644 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:04.011808 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:04.011809 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:04.011860 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:04.011901 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":101,"threads_started":1}
I20260812 16:42:04.020560 24092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:04.020756 24092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:04.021544 24092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b80617551dc64aae9c59bf8d4b06da18: Sending DeleteTablet for 3 replicas of tablet 5b12c5ad7e4947e18198575978db00f7
I20260812 16:42:04.021797 24358 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b12c5ad7e4947e18198575978db00f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:04 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:55448
I20260812 16:42:04.021904 24907 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b12c5ad7e4947e18198575978db00f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:04 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:37182
I20260812 16:42:04.022091 25148 tablet_replica.cc:330] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: stopping tablet replica
I20260812 16:42:04.022167 25148 raft_consensus.cc:2229] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:04.022226 25148 raft_consensus.cc:2258] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:04.022316 25145 tablet_replica.cc:330] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: stopping tablet replica
I20260812 16:42:04.022380 25145 raft_consensus.cc:2229] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:04.022419 25145 raft_consensus.cc:2258] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:04.022598 24646 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b12c5ad7e4947e18198575978db00f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:04 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52750
I20260812 16:42:04.022716 25144 tablet_replica.cc:330] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: stopping tablet replica
I20260812 16:42:04.022779 25144 raft_consensus.cc:2229] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:04.022814 25144 raft_consensus.cc:2258] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:04.022828 25148 ts_tablet_manager.cc:1905] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:04.023002 25145 ts_tablet_manager.cc:1905] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:04.024573 25148 ts_tablet_manager.cc:1918] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:04.024587 25144 ts_tablet_manager.cc:1905] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:04.024642 25148 log.cc:1196] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/5b12c5ad7e4947e18198575978db00f7
I20260812 16:42:04.024869 25148 ts_tablet_manager.cc:1939] T 5b12c5ad7e4947e18198575978db00f7 P 995a2774332349a194d20b3f9cdc29b7: Deleting consensus metadata
I20260812 16:42:04.025226 24069 catalog_manager.cc:4841] TS 995a2774332349a194d20b3f9cdc29b7 (127.21.114.65:38111): tablet 5b12c5ad7e4947e18198575978db00f7 (table test-table [id=4a4212b28f4447c99a31da9543ac622d]) successfully deleted
I20260812 16:42:04.026284 25144 ts_tablet_manager.cc:1918] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:04.026360 25144 log.cc:1196] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/5b12c5ad7e4947e18198575978db00f7
I20260812 16:42:04.026577 25144 ts_tablet_manager.cc:1939] T 5b12c5ad7e4947e18198575978db00f7 P 8cc7eb3d34024e01ae321d4ce1481080: Deleting consensus metadata
I20260812 16:42:04.027014 24063 catalog_manager.cc:4841] TS 8cc7eb3d34024e01ae321d4ce1481080 (127.21.114.66:36229): tablet 5b12c5ad7e4947e18198575978db00f7 (table test-table [id=4a4212b28f4447c99a31da9543ac622d]) successfully deleted
I20260812 16:42:04.027086 25145 ts_tablet_manager.cc:1918] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:04.027148 25145 log.cc:1196] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/5b12c5ad7e4947e18198575978db00f7
I20260812 16:42:04.027365 25145 ts_tablet_manager.cc:1939] T 5b12c5ad7e4947e18198575978db00f7 P 7571e29c61c546dda23be1c22491ca4e: Deleting consensus metadata
I20260812 16:42:04.027783 24067 catalog_manager.cc:4841] TS 7571e29c61c546dda23be1c22491ca4e (127.21.114.67:35325): tablet 5b12c5ad7e4947e18198575978db00f7 (table test-table [id=4a4212b28f4447c99a31da9543ac622d]) successfully deleted
Aug 12 16:42:04 dist-test-slave-45dx krb5kdc[24007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552923, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:04.035122 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:04.024367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.21.114.65:38111)
0812 16:42:04.024536 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:04.024538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:04.025321 (+ 783us) server_negotiation.cc:407] Connection header received
0812 16:42:04.025414 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:04.025415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:04.025428 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:04.025478 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:04.026066 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.026869 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.027829 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.028135 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.028207 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:04.031766 (+ 3559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:04.031778 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:04.031778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:04.031787 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:04.033908 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:04.034276 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:04.034280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:04.034281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:04.034358 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:04.034554 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:04.034555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:04.034555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:04.034743 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:04.034892 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:04.034937 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 16:42:04.035023 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
W20260812 16:42:04.035398 24496 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55464
I20260812 16:42:04.043154 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:04.036448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.21.114.126:43431)
0812 16:42:04.036499 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:04.036501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:04.036531 (+ 30us) server_negotiation.cc:407] Connection header received
0812 16:42:04.036605 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:04.036606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:04.036614 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:04.036660 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:04.037256 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.037769 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.038748 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:04.038946 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:04.039015 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:04.040387 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:04.040388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:04.040389 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:04.040396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:04.041937 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:04.042313 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:04.042314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:04.042314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:04.042368 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:04.042608 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:04.042609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:04.042610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:04.042716 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:04.042790 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:04.042957 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 16:42:04.043038 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 16:42:04.043434 24092 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33270
I20260812 16:42:04.044272 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24247
I20260812 16:42:04.058841 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24523
I20260812 16:42:04.073937 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24787
I20260812 16:42:04.086465 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24036
2026-08-12T16:42:04Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2727 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:04 dist-test-slave-45dx krb5kdc[25220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:04 dist-test-slave-45dx krb5kdc[25220](info): set up 2 sockets
Aug 12 16:42:04 dist-test-slave-45dx krb5kdc[25220](info): commencing operation
krb5kdc: starting...
W20260812 16:42:05.410312 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:05 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:05.533201 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:32987
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:32987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:05.617511 25247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:05.617723 25247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:05.617748 25247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:05.618906 25247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:05.618950 25247 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 16:42:05.618963 25247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:05.619004 25247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:05.619033 25247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:05.619050 25247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:05.620579 25247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:32987
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:32987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:05.620841 25247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:05.621089 25247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:05.626148 25259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:05.626180 25256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:05.626222 25257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:05.626226 25247 server_base.cc:1034] running on GCE node
I20260812 16:42:05.626627 25247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:05.626955 25247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:05.628123 25247 hybrid_clock.cc:648] HybridClock initialized: now 1786552925628101 us; error 44 us; skew 500 ppm
Aug 12 16:42:05 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552925, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:05.630646 25247 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:05.631081 25247 webserver.cc:460] Webserver started at http://127.21.114.126:36163/ using document root <none> and password file <none>
I20260812 16:42:05.631304 25247 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:05.631352 25247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:05.631527 25247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:05.632678 25247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "a408b9e29c22433ab6990f78600a1ed4"
format_stamp: "Formatted at 2026-08-12 16:42:05 on dist-test-slave-45dx"
server_key: "85af7de808341bfe21633a7e5fe643ba"
server_key_iv: "7cd5be2806f778c945277c51ef5c11e1"
server_key_version: "encryptionkey@0"
I20260812 16:42:05.633057 25247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "a408b9e29c22433ab6990f78600a1ed4"
format_stamp: "Formatted at 2026-08-12 16:42:05 on dist-test-slave-45dx"
server_key: "85af7de808341bfe21633a7e5fe643ba"
server_key_iv: "7cd5be2806f778c945277c51ef5c11e1"
server_key_version: "encryptionkey@0"
I20260812 16:42:05.634385 25247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:05.635111 25274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:05.635303 25247 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:05.635403 25247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "a408b9e29c22433ab6990f78600a1ed4"
format_stamp: "Formatted at 2026-08-12 16:42:05 on dist-test-slave-45dx"
server_key: "85af7de808341bfe21633a7e5fe643ba"
server_key_iv: "7cd5be2806f778c945277c51ef5c11e1"
server_key_version: "encryptionkey@0"
I20260812 16:42:05.635476 25247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:05.651094 25247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:05.652948 25247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:05.653100 25247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:05.657850 25247 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:32987
I20260812 16:42:05.657903 25387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:32987 every 8 connection(s)
I20260812 16:42:05.658210 25247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:05.658851 25388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:05.661270 25388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Bootstrap starting.
I20260812 16:42:05.661888 25388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:05.662187 25388 log.cc:824] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:05.662873 25388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: No bootstrap required, opened a new log
I20260812 16:42:05.665105 25388 raft_consensus.cc:348] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a408b9e29c22433ab6990f78600a1ed4" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32987 } }
I20260812 16:42:05.665271 25388 raft_consensus.cc:374] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:05.665337 25388 raft_consensus.cc:729] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a408b9e29c22433ab6990f78600a1ed4, State: Initialized, Role: FOLLOWER
I20260812 16:42:05.665508 25388 consensus_queue.cc:260] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a408b9e29c22433ab6990f78600a1ed4" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32987 } }
I20260812 16:42:05.665594 25388 raft_consensus.cc:388] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:05.665638 25388 raft_consensus.cc:482] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:05.665686 25388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:05.666216 25388 raft_consensus.cc:504] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a408b9e29c22433ab6990f78600a1ed4" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32987 } }
I20260812 16:42:05.666339 25388 leader_election.cc:302] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a408b9e29c22433ab6990f78600a1ed4; no voters:
I20260812 16:42:05.666518 25388 leader_election.cc:288] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:05.666548 25395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:05.666720 25395 raft_consensus.cc:686] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [term 1 LEADER]: Becoming Leader. State: Replica: a408b9e29c22433ab6990f78600a1ed4, State: Running, Role: LEADER
I20260812 16:42:05.666781 25388 sys_catalog.cc:564] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:05.666857 25395 consensus_queue.cc:237] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a408b9e29c22433ab6990f78600a1ed4" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32987 } }
I20260812 16:42:05.667266 25402 sys_catalog.cc:455] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a408b9e29c22433ab6990f78600a1ed4. Latest consensus state: current_term: 1 leader_uuid: "a408b9e29c22433ab6990f78600a1ed4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a408b9e29c22433ab6990f78600a1ed4" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32987 } } }
I20260812 16:42:05.667261 25398 sys_catalog.cc:455] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a408b9e29c22433ab6990f78600a1ed4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a408b9e29c22433ab6990f78600a1ed4" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32987 } } }
I20260812 16:42:05.667466 25398 sys_catalog.cc:458] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:05.667455 25402 sys_catalog.cc:458] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:05.667984 25419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:05.668251 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25247
I20260812 16:42:05.668375 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:05.668570 21961 external_mini_cluster.cc:1428] Setting key af8557c2221e31d40b49105475cc6990
I20260812 16:42:05.668589 25419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:05.670334 25419 catalog_manager.cc:1347] Generated new cluster ID: cb5f271ec00d48fa87f81a1f0da1d437
I20260812 16:42:05.670389 25419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:42:05 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552925, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:05.680518 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:05.669011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58588 (local address 127.21.114.126:32987)
0812 16:42:05.669402 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:05.669411 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:05.669446 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:42:05.669539 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:05.669545 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:05.669586 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:05.669731 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:05.670624 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.672033 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.673112 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.673791 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.673910 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:05.676733 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:05.676737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:05.676737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:05.676749 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:05.678713 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:05.679136 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:05.679139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:05.679139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:05.679243 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:05.679466 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:05.679467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:05.679467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:05.679765 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:05.679906 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:05.680038 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 16:42:05.680265 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":66,"threads_started":1}
I20260812 16:42:05.695166 25419 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:05.695902 25419 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:05.701205 25419 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Generated new TSK 0
I20260812 16:42:05.701406 25419 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:05.737112 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:32987
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:05.819950 25440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:05.820156 25440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:05.820182 25440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:05.821353 25440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:05.821398 25440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:05.821419 25440 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 16:42:05.821465 25440 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:05.821501 25440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:05.823069 25440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:05.823287 25440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:05.823490 25440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:05.828528 25452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:05.828553 25440 server_base.cc:1034] running on GCE node
W20260812 16:42:05.828554 25454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:05.828528 25451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:05.828938 25440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:05.829185 25440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:05.830356 25440 hybrid_clock.cc:648] HybridClock initialized: now 1786552925830339 us; error 44 us; skew 500 ppm
Aug 12 16:42:05 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552925, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:05.832995 25440 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:05.833381 25440 webserver.cc:460] Webserver started at http://127.21.114.65:46787/ using document root <none> and password file <none>
I20260812 16:42:05.833563 25440 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:05.833603 25440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:05.833691 25440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:05.834672 25440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "7fdd0c3b7db443d980930da4f9fec1b0"
format_stamp: "Formatted at 2026-08-12 16:42:05 on dist-test-slave-45dx"
server_key: "2cf4fba61a83c9c780c711bb8504cd3d"
server_key_iv: "a8f046193e50e08d8be4929e0356fd76"
server_key_version: "encryptionkey@0"
I20260812 16:42:05.834973 25440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "7fdd0c3b7db443d980930da4f9fec1b0"
format_stamp: "Formatted at 2026-08-12 16:42:05 on dist-test-slave-45dx"
server_key: "2cf4fba61a83c9c780c711bb8504cd3d"
server_key_iv: "a8f046193e50e08d8be4929e0356fd76"
server_key_version: "encryptionkey@0"
I20260812 16:42:05.836196 25440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:05.837066 25471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:05.837232 25440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:05.837318 25440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "7fdd0c3b7db443d980930da4f9fec1b0"
format_stamp: "Formatted at 2026-08-12 16:42:05 on dist-test-slave-45dx"
server_key: "2cf4fba61a83c9c780c711bb8504cd3d"
server_key_iv: "a8f046193e50e08d8be4929e0356fd76"
server_key_version: "encryptionkey@0"
I20260812 16:42:05.837378 25440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:05.862746 25440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:05.864846 25440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:05.864962 25440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:05.865440 25440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:05.865475 25440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:05.865504 25440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:05.865561 25440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:05 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552925, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:05.873199 25440 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:41171
I20260812 16:42:05.873292 25679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:41171 every 8 connection(s)
I20260812 16:42:05.873606 25440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:05.877125 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:05.866029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:45785 (local address 127.21.114.126:32987)
0812 16:42:05.866104 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:05.866106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:05.866366 (+ 260us) server_negotiation.cc:407] Connection header received
0812 16:42:05.867163 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:05.867164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:05.867187 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:05.867257 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:05.868216 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.869076 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.870089 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.870313 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.870395 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:05.873272 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:05.873273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:05.873274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:05.873283 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:05.874769 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:05.875157 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:05.875158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:05.875158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:05.875213 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:05.876361 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:05.876362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:05.876362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:05.876558 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:05.876650 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:05.876975 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 16:42:05.877060 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 16:42:05.877298 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:05.865981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.21.114.65:45785)
0812 16:42:05.866212 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:05.866265 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:05.867025 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:05.867359 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:05.867364 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:05.867775 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:05.868101 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:05.868110 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.869172 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.869174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:05.869981 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:05.869984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.870423 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.870424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:05.870580 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:05.871109 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:05.871117 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:05.873144 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:05.874856 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:05.874861 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:05.874863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:05.875087 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:05.875276 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:05.875276 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:05.875277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:05.875396 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:05.876627 (+ 1231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:05.876635 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:05.876808 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 16:42:05.876940 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 16:42:05.877072 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":117,"threads_started":1}
I20260812 16:42:05.877966 25681 heartbeater.cc:347] Connected to a master server at 127.21.114.126:32987
I20260812 16:42:05.878062 25681 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:05.878257 25681 heartbeater.cc:511] Master 127.21.114.126:32987 requested a full tablet report, sending...
I20260812 16:42:05.878804 25307 ts_manager.cc:194] Registered new tserver with Master: 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171)
I20260812 16:42:05.879880 25307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:45785
I20260812 16:42:05.882884 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25440
I20260812 16:42:05.883003 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:05.883236 21961 external_mini_cluster.cc:1428] Setting key 06ded18c30a9e3edaaed3b91af2ee717
I20260812 16:42:05.885270 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:05.879082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:46585 (local address 127.21.114.126:32987)
0812 16:42:05.879124 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:05.879126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:05.879219 (+ 93us) server_negotiation.cc:407] Connection header received
0812 16:42:05.879248 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:05.879249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:05.879258 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:05.879323 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:05.879811 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.880605 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.881324 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.881523 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.881583 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:05.882463 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:05.882464 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:05.882464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:05.882471 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:05.884108 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:05.884499 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:05.884500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:05.884500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:05.884560 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:05.884758 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:05.884759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:05.884759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:05.884871 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:05.884948 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:05.885110 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 16:42:05.885183 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:05.885279 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:05.879020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.21.114.65:46585)
0812 16:42:05.879148 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:05.879165 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:05.879214 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:05.879326 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:05.879326 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:05.879485 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:05.879695 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:05.879699 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.880711 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.880712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:05.881243 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:05.881245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:05.881593 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:05.881594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:05.881654 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:05.882107 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:05.882112 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:05.882378 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:05.884187 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:05.884188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:05.884189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:05.884419 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:05.884632 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:05.884633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:05.884633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:05.884696 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:05.884943 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:05.884944 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:05.884992 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 16:42:05.885069 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 16:42:05.885179 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:05.910785 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:32987
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:05.993360 25699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:05.993551 25699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:05.993574 25699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:05.994632 25699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:05.994663 25699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:05.994683 25699 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 16:42:05.994694 25699 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:05.994710 25699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:05.996065 25699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:05.996245 25699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:05.996526 25699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:06.001343 25710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:06.001356 25706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:06.001361 25708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:06.001745 25699 server_base.cc:1034] running on GCE node
I20260812 16:42:06.001912 25699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:06.002105 25699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:06.003242 25699 hybrid_clock.cc:648] HybridClock initialized: now 1786552926003235 us; error 33 us; skew 500 ppm
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552926, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:06.005816 25699 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:06.006286 25699 webserver.cc:460] Webserver started at http://127.21.114.66:39341/ using document root <none> and password file <none>
I20260812 16:42:06.006541 25699 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:06.006613 25699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:06.006763 25699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:06.007781 25699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "0ca1c4015e144e52bbb19f7fff212da2"
format_stamp: "Formatted at 2026-08-12 16:42:06 on dist-test-slave-45dx"
server_key: "64b233fc0f7d8feaef723eb15f59d865"
server_key_iv: "891c3c5acbdb561f7f94c12bd99e9a3b"
server_key_version: "encryptionkey@0"
I20260812 16:42:06.008145 25699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "0ca1c4015e144e52bbb19f7fff212da2"
format_stamp: "Formatted at 2026-08-12 16:42:06 on dist-test-slave-45dx"
server_key: "64b233fc0f7d8feaef723eb15f59d865"
server_key_iv: "891c3c5acbdb561f7f94c12bd99e9a3b"
server_key_version: "encryptionkey@0"
I20260812 16:42:06.009501 25699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:06.010202 25719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.010385 25699 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:06.010490 25699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "0ca1c4015e144e52bbb19f7fff212da2"
format_stamp: "Formatted at 2026-08-12 16:42:06 on dist-test-slave-45dx"
server_key: "64b233fc0f7d8feaef723eb15f59d865"
server_key_iv: "891c3c5acbdb561f7f94c12bd99e9a3b"
server_key_version: "encryptionkey@0"
I20260812 16:42:06.010574 25699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:06.030181 25699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:06.032655 25699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:06.032847 25699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:06.033452 25699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:06.033512 25699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.033555 25699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:06.033577 25699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552926, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:06.041250 25699 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:46703
I20260812 16:42:06.041368 25940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:46703 every 8 connection(s)
I20260812 16:42:06.041689 25699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:06.043540 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.033846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:34253 (local address 127.21.114.126:32987)
0812 16:42:06.033922 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.033924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.034233 (+ 309us) server_negotiation.cc:407] Connection header received
0812 16:42:06.034720 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.034722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.034735 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.034820 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:06.035512 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.036061 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.037144 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.037364 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.037444 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.040469 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:06.040471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:06.040471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:06.040480 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:06.042354 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.042717 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.042718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.042718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.042773 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.043001 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.043001 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.043001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.043117 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:06.043174 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.043408 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.043476 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:42:06.043689 25735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.033854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.21.114.66:34253)
0812 16:42:06.034086 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.034130 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.034620 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.034894 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.034897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.035127 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:06.035396 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.035402 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.036159 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.036160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.037049 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.037052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.037478 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.037480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.037603 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.038125 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:06.038137 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:06.040380 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:06.042426 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.042431 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.042432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.042649 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.042829 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.042829 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.042830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.042936 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.043175 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:06.043179 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:06.043293 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.043372 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.043497 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":156,"threads_started":1}
I20260812 16:42:06.044206 25941 heartbeater.cc:347] Connected to a master server at 127.21.114.126:32987
I20260812 16:42:06.044296 25941 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:06.044515 25941 heartbeater.cc:511] Master 127.21.114.126:32987 requested a full tablet report, sending...
I20260812 16:42:06.044971 25305 ts_manager.cc:194] Registered new tserver with Master: 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703)
I20260812 16:42:06.045469 25305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:34253
I20260812 16:42:06.046360 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25699
I20260812 16:42:06.046468 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:06.046655 21961 external_mini_cluster.cc:1428] Setting key 4e9819d62557a5c0c558149b7573f24f
I20260812 16:42:06.051617 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.045362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:41481 (local address 127.21.114.126:32987)
0812 16:42:06.045407 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.045408 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.045510 (+ 102us) server_negotiation.cc:407] Connection header received
0812 16:42:06.045579 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.045580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.045590 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.045651 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:06.046010 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.046530 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.047544 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.047737 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.047788 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.048827 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:06.048828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:06.048828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:06.048834 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:06.050516 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.050864 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.050865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.050866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.050940 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.051151 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.051152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.051152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.051286 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:06.051339 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.051500 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.051558 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:06.051764 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.045268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.21.114.66:41481)
0812 16:42:06.045448 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.045459 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.045526 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.045656 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.045657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.045867 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:06.045930 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.045932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.046641 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.046643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.047447 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.047450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.047809 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.047810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.047894 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.048331 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:06.048337 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:06.048739 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:06.050599 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.050600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.050600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.050763 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.051013 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.051014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.051015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.051088 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.051350 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:06.051352 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:06.051403 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.051483 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.051603 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:06.075315 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:32987
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:06.159531 25960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:06.159750 25960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:06.159775 25960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:06.160977 25960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:06.161022 25960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:06.161043 25960 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 16:42:06.161055 25960 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:06.161072 25960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:06.162498 25960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:06.162737 25960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:06.162971 25960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:06.168128 25974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:06.168177 25969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:06.168233 25966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:06.168378 25960 server_base.cc:1034] running on GCE node
I20260812 16:42:06.168572 25960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:06.168774 25960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:06.169914 25960 hybrid_clock.cc:648] HybridClock initialized: now 1786552926169903 us; error 30 us; skew 500 ppm
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552926, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:06.172807 25960 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:06.173267 25960 webserver.cc:460] Webserver started at http://127.21.114.67:42725/ using document root <none> and password file <none>
I20260812 16:42:06.173473 25960 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:06.173513 25960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:06.173605 25960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:06.174618 25960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "e4ae5164479f42e1a96348e4a95bddad"
format_stamp: "Formatted at 2026-08-12 16:42:06 on dist-test-slave-45dx"
server_key: "072bd094357965284f820ca645f1478c"
server_key_iv: "44354f1107bb4a03e63c3b7b645d5653"
server_key_version: "encryptionkey@0"
I20260812 16:42:06.174932 25960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "e4ae5164479f42e1a96348e4a95bddad"
format_stamp: "Formatted at 2026-08-12 16:42:06 on dist-test-slave-45dx"
server_key: "072bd094357965284f820ca645f1478c"
server_key_iv: "44354f1107bb4a03e63c3b7b645d5653"
server_key_version: "encryptionkey@0"
I20260812 16:42:06.176174 25960 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 16:42:06.176941 25988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.177121 25960 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:06.177225 25960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "e4ae5164479f42e1a96348e4a95bddad"
format_stamp: "Formatted at 2026-08-12 16:42:06 on dist-test-slave-45dx"
server_key: "072bd094357965284f820ca645f1478c"
server_key_iv: "44354f1107bb4a03e63c3b7b645d5653"
server_key_version: "encryptionkey@0"
I20260812 16:42:06.177307 25960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:06.198944 25960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:06.201242 25960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:06.201457 25960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:06.202108 25960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:06.202169 25960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.202201 25960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:06.202224 25960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552926, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:06.209649 25960 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:45799
I20260812 16:42:06.210093 26209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:45799 every 8 connection(s)
I20260812 16:42:06.210446 25960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:06.210902 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25960
I20260812 16:42:06.211014 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:06.211226 21961 external_mini_cluster.cc:1428] Setting key 2d01fabe1f534f0265a8268c6fdb6da6
I20260812 16:42:06.212800 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.202523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:60727 (local address 127.21.114.126:32987)
0812 16:42:06.202586 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.202589 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.202808 (+ 219us) server_negotiation.cc:407] Connection header received
0812 16:42:06.203357 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.203358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.203372 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.203421 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:06.204074 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.204691 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.205740 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.205948 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.206029 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.209152 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:06.209154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:06.209155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:06.209163 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:06.210983 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.211516 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.211517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.211517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.211615 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.211992 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.211993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.211993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.212166 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:06.212245 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.212617 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.212710 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:42:06.213006 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.202510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.21.114.67:60727)
0812 16:42:06.202679 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.202720 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.203239 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.203513 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.203517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.203773 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:06.203971 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.203976 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.204796 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.204798 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.205640 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.205642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.206038 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.206039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.206169 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.206729 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:06.206738 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:06.209030 (+ 2292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:06.211078 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.211084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.211087 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.211407 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.211700 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.211701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.211702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.211908 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.212248 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:06.212256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:06.212439 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.212589 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.212761 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260812 16:42:06.213475 26210 heartbeater.cc:347] Connected to a master server at 127.21.114.126:32987
I20260812 16:42:06.213562 26210 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:06.213757 26210 heartbeater.cc:511] Master 127.21.114.126:32987 requested a full tablet report, sending...
I20260812 16:42:06.214138 25307 ts_manager.cc:194] Registered new tserver with Master: e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.214661 25307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:60727
I20260812 16:42:06.219959 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.214806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:53573 (local address 127.21.114.126:32987)
0812 16:42:06.214871 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.214872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.214881 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:06.214902 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.214903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.214913 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.214960 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:06.215290 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.215768 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.216539 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.216737 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.216806 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.217603 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:06.217604 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:06.217604 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:06.217612 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:06.218817 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.219187 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.219188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.219189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.219245 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.219454 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.219455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.219456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.219566 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:06.219636 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.219804 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.219873 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:06.219990 26227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.214540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.21.114.67:53573)
0812 16:42:06.214672 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.214684 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.214736 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.214980 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.214981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.215161 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:06.215213 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.215214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.215871 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.215872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.216449 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.216451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.216807 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.216808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.216897 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.217245 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:06.217249 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:06.217515 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:06.218934 (+ 1419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.218935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.218935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.219110 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.219318 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.219319 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.219319 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.219383 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.219639 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:06.219640 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:06.219686 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.219765 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.219873 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260812 16:42:06.223102 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:06.247313 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.240025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58590 (local address 127.21.114.126:32987)
0812 16:42:06.240072 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.240075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.240086 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:06.240150 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.240151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.240167 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.240228 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:06.240867 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.241361 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.242138 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.242333 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.242417 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.244825 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:06.244827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:06.244827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:06.244836 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:06.246146 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.246507 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.246509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.246509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.246572 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.246779 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.246780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.246781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.246901 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:06.247010 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.247122 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.247205 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:06.248925 25307 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:06.250463 25307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:06.257141 26246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.252910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:45799 (local address 127.0.0.1:52392)
0812 16:42:06.253077 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.253120 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.253185 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.253739 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.253740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.253742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.253802 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.253804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.254696 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.254697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.255889 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.255892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.256812 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.256813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.256896 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.256910 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.256986 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.257036 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":3,"thread_start_us":59,"threads_started":1}
I20260812 16:42:06.257311 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.252919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.0.0.1:44902)
0812 16:42:06.253229 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.253240 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.253302 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.253613 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.253616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.253619 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.253692 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.253694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.255104 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.255105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.256114 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.256115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.257081 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.257082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.257152 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.257157 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.257190 (+ 33us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.257236 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":84,"threads_started":1}
I20260812 16:42:06.257184 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.253010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52392 (local address 127.21.114.67:45799)
0812 16:42:06.253574 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.253577 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.253587 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:06.253623 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.253625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.253639 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.253882 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.253959 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.254605 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.255982 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.256719 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.256802 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.256862 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.257023 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.257079 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":103,"threads_started":1}
I20260812 16:42:06.257728 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.253123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44902 (local address 127.21.114.65:41171)
0812 16:42:06.253427 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.253432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.253441 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:06.253481 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.253483 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.253499 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.253778 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.253872 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.255009 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.256206 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.256957 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.257484 (+ 527us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.257560 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.257589 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.257627 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":75,"threads_started":1}
I20260812 16:42:06.258204 26072 tablet_service.cc:1467] Processing CreateTablet for tablet 3adc7cbb97314735a30f69fffdbb75b0 (DEFAULT_TABLE table=test-table [id=e4bec179c712405d93976e3645f678f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:06.258360 26247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.253107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:46703 (local address 127.0.0.1:33270)
0812 16:42:06.253285 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.253295 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.253338 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.253738 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.253739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.253742 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.253802 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.253805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.256196 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.256196 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.257060 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.257062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.258123 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.258124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.258187 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.258192 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.258255 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.258296 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260812 16:42:06.258447 26252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.253330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.21.114.66:46703)
0812 16:42:06.253501 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.253506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.253518 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:42:06.253560 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.253562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.253579 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.253667 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.253892 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.255009 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.257152 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.257959 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.258033 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.258085 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.258291 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.258337 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260812 16:42:06.258370 25560 tablet_service.cc:1467] Processing CreateTablet for tablet 3adc7cbb97314735a30f69fffdbb75b0 (DEFAULT_TABLE table=test-table [id=e4bec179c712405d93976e3645f678f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:06.258618 26072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3adc7cbb97314735a30f69fffdbb75b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.258741 25560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3adc7cbb97314735a30f69fffdbb75b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.259042 25800 tablet_service.cc:1467] Processing CreateTablet for tablet 3adc7cbb97314735a30f69fffdbb75b0 (DEFAULT_TABLE table=test-table [id=e4bec179c712405d93976e3645f678f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:06.259361 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3adc7cbb97314735a30f69fffdbb75b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.262856 26256 tablet_bootstrap.cc:492] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Bootstrap starting.
I20260812 16:42:06.262974 26255 tablet_bootstrap.cc:492] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Bootstrap starting.
I20260812 16:42:06.263603 26256 tablet_bootstrap.cc:654] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.263811 26255 tablet_bootstrap.cc:654] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.263970 26256 log.cc:824] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:06.264154 26255 log.cc:824] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:06.264938 26256 tablet_bootstrap.cc:492] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: No bootstrap required, opened a new log
I20260812 16:42:06.265098 26256 ts_tablet_manager.cc:1397] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:06.265715 26255 tablet_bootstrap.cc:492] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: No bootstrap required, opened a new log
I20260812 16:42:06.265793 26255 ts_tablet_manager.cc:1397] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:42:06.267385 26256 raft_consensus.cc:348] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.267578 26256 raft_consensus.cc:374] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.267617 26256 raft_consensus.cc:729] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca1c4015e144e52bbb19f7fff212da2, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.267758 26256 consensus_queue.cc:260] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.267812 26255 raft_consensus.cc:348] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.267994 26255 raft_consensus.cc:374] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.268033 26255 raft_consensus.cc:729] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.268038 26256 ts_tablet_manager.cc:1428] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:06.268085 25941 heartbeater.cc:503] Master 127.21.114.126:32987 was elected leader, sending a full tablet report...
I20260812 16:42:06.268168 26255 consensus_queue.cc:260] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.268226 26253 tablet_bootstrap.cc:492] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Bootstrap starting.
I20260812 16:42:06.268468 26255 ts_tablet_manager.cc:1428] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:06.268607 26210 heartbeater.cc:503] Master 127.21.114.126:32987 was elected leader, sending a full tablet report...
I20260812 16:42:06.269080 26253 tablet_bootstrap.cc:654] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.269470 26253 log.cc:824] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:06.270483 26253 tablet_bootstrap.cc:492] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: No bootstrap required, opened a new log
I20260812 16:42:06.270540 26253 ts_tablet_manager.cc:1397] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:06.271878 26253 raft_consensus.cc:348] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.272006 26253 raft_consensus.cc:374] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.272053 26253 raft_consensus.cc:729] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.272166 26253 consensus_queue.cc:260] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.272480 26253 ts_tablet_manager.cc:1428] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:06.272506 25681 heartbeater.cc:503] Master 127.21.114.126:32987 was elected leader, sending a full tablet report...
W20260812 16:42:06.292435 25943 tablet.cc:2369] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:06.374329 25682 tablet.cc:2369] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:06.379734 26270 raft_consensus.cc:482] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:06.379845 26270 raft_consensus.cc:504] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.380206 26270 leader_election.cc:288] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703), e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.383373 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.380512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:46703 (local address 127.21.114.65:47055)
0812 16:42:06.380671 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.380681 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.380751 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.380901 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.380902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.380905 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.380986 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.380989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.381756 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.381757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.382550 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.382552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.383094 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.383095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.383169 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.383173 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.383227 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.383257 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":20,"thread_start_us":67,"threads_started":1}
I20260812 16:42:06.383376 26252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.380585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:47055 (local address 127.21.114.66:46703)
0812 16:42:06.380636 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.380638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.380778 (+ 140us) server_negotiation.cc:407] Connection header received
0812 16:42:06.380812 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.380814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.380825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.380885 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.381067 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.381657 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.382646 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.383011 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.383068 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.383098 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.383249 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.383302 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:06.383436 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.380589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:45771 (local address 127.21.114.67:45799)
0812 16:42:06.380645 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.380647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.380738 (+ 91us) server_negotiation.cc:407] Connection header received
0812 16:42:06.380839 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.380840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.380848 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.380920 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.381131 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.381606 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.382672 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.383022 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.383113 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.383121 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.383315 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.383359 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 16:42:06.383669 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.380431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:45799 (local address 127.21.114.65:45771)
0812 16:42:06.380652 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.380663 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.380754 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.380949 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.380950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.380952 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.381056 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.381059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.381688 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.381689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.382553 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.382556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.383136 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.383137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.383234 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.383239 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.383297 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.383334 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":37,"thread_start_us":111,"threads_started":1}
I20260812 16:42:06.383818 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adc7cbb97314735a30f69fffdbb75b0" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2" is_pre_election: true
I20260812 16:42:06.383947 25839 raft_consensus.cc:2454] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 0.
I20260812 16:42:06.384132 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adc7cbb97314735a30f69fffdbb75b0" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4ae5164479f42e1a96348e4a95bddad" is_pre_election: true
I20260812 16:42:06.384172 25476 leader_election.cc:302] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, 7fdd0c3b7db443d980930da4f9fec1b0; no voters:
I20260812 16:42:06.384287 26110 raft_consensus.cc:2454] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 0.
I20260812 16:42:06.384325 26270 raft_consensus.cc:2781] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:06.384374 26270 raft_consensus.cc:482] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:06.384397 26270 raft_consensus.cc:3037] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.385133 26270 raft_consensus.cc:504] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.385293 26270 leader_election.cc:288] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703), e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.385443 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adc7cbb97314735a30f69fffdbb75b0" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2"
I20260812 16:42:06.385537 25839 raft_consensus.cc:3037] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.385618 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3adc7cbb97314735a30f69fffdbb75b0" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4ae5164479f42e1a96348e4a95bddad"
I20260812 16:42:06.385722 26110 raft_consensus.cc:3037] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.386337 25839 raft_consensus.cc:2454] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 1.
I20260812 16:42:06.386452 26110 raft_consensus.cc:2454] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 1.
I20260812 16:42:06.386523 25476 leader_election.cc:302] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, 7fdd0c3b7db443d980930da4f9fec1b0; no voters:
I20260812 16:42:06.386632 26270 raft_consensus.cc:2781] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:06.386788 26270 raft_consensus.cc:686] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Running, Role: LEADER
I20260812 16:42:06.386900 26270 consensus_queue.cc:237] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.387856 25307 catalog_manager.cc:5495] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } health_report { overall_health: UNKNOWN } } }
Aug 12 16:42:06 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552925, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:06.432029 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.425082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58594 (local address 127.21.114.126:32987)
0812 16:42:06.425167 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.425170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.425276 (+ 106us) server_negotiation.cc:407] Connection header received
0812 16:42:06.425395 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.425396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.425406 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.425481 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:06.425967 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.426468 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.427176 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.427374 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.427463 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.429552 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:06.429554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:06.429554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:06.429561 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:06.430760 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.431159 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.431160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.431161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.431218 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:06.431425 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:06.431426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:06.431426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:06.431541 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:06.431611 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.431777 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.431916 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":52}
I20260812 16:42:06.432113 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.424994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32987 (local address 127.0.0.1:58594)
0812 16:42:06.425200 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.425211 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.425298 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.425486 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.425488 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.425824 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:06.425877 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.425879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.426556 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.426557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.427084 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.427086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.427466 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.427467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.427528 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.428040 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:06.428045 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:06.429459 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:06.430867 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.430874 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.430877 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.431073 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.431290 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:06.431290 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:06.431290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:06.431356 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:06.431614 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:06.431623 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:06.431670 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.431753 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.431976 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":118,"thread_start_us":114,"threads_started":1}
I20260812 16:42:06.434088 25307 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:58594:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 16:42:06.434299 25307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:06.435864 25800 tablet_service.cc:1467] Processing CreateTablet for tablet e7b297c8bdd34473bd90a926d25f5890 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=88a662b28ba04fdb89729a2c85d73068]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:06.435864 25560 tablet_service.cc:1467] Processing CreateTablet for tablet e7b297c8bdd34473bd90a926d25f5890 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=88a662b28ba04fdb89729a2c85d73068]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:06.435940 26072 tablet_service.cc:1467] Processing CreateTablet for tablet e7b297c8bdd34473bd90a926d25f5890 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=88a662b28ba04fdb89729a2c85d73068]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:06.436045 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b297c8bdd34473bd90a926d25f5890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.436045 25560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b297c8bdd34473bd90a926d25f5890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.436141 26072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b297c8bdd34473bd90a926d25f5890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.437463 26255 tablet_bootstrap.cc:492] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: Bootstrap starting.
I20260812 16:42:06.437585 26256 tablet_bootstrap.cc:492] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: Bootstrap starting.
I20260812 16:42:06.438144 26255 tablet_bootstrap.cc:654] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.438277 26256 tablet_bootstrap.cc:654] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.438663 26253 tablet_bootstrap.cc:492] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: Bootstrap starting.
I20260812 16:42:06.439051 26255 tablet_bootstrap.cc:492] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: No bootstrap required, opened a new log
I20260812 16:42:06.439066 26253 tablet_bootstrap.cc:654] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.439088 26256 tablet_bootstrap.cc:492] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: No bootstrap required, opened a new log
I20260812 16:42:06.439098 26255 ts_tablet_manager.cc:1397] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 16:42:06.439123 26256 ts_tablet_manager.cc:1397] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:06.439241 26256 raft_consensus.cc:348] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.439288 26256 raft_consensus.cc:374] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.439302 26256 raft_consensus.cc:729] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca1c4015e144e52bbb19f7fff212da2, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.439275 26255 raft_consensus.cc:348] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.439366 26255 raft_consensus.cc:374] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.439384 26255 raft_consensus.cc:729] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.439378 26256 consensus_queue.cc:260] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.439442 26255 consensus_queue.cc:260] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.439492 26256 ts_tablet_manager.cc:1428] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:06.439560 26255 ts_tablet_manager.cc:1428] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.439620 26262 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.439632 26264 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.439733 26262 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:06.439733 26264 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:06.440328 26253 tablet_bootstrap.cc:492] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: No bootstrap required, opened a new log
I20260812 16:42:06.440387 26253 ts_tablet_manager.cc:1397] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:06.440541 26253 raft_consensus.cc:348] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.440618 26253 raft_consensus.cc:374] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.440644 26253 raft_consensus.cc:729] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.440697 26253 consensus_queue.cc:260] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.440789 26253 ts_tablet_manager.cc:1428] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.440848 26270 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.440985 26270 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 16:42:06.461697 26211 tablet.cc:2369] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:06.470824 26270 raft_consensus.cc:482] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:06.470942 26270 raft_consensus.cc:504] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.471141 26270 leader_election.cc:288] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703), e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.471378 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b297c8bdd34473bd90a926d25f5890" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4ae5164479f42e1a96348e4a95bddad" is_pre_election: true
I20260812 16:42:06.471390 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b297c8bdd34473bd90a926d25f5890" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2" is_pre_election: true
I20260812 16:42:06.471491 26110 raft_consensus.cc:2454] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 0.
I20260812 16:42:06.471499 25839 raft_consensus.cc:2454] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 0.
I20260812 16:42:06.471679 25475 leader_election.cc:302] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fdd0c3b7db443d980930da4f9fec1b0, e4ae5164479f42e1a96348e4a95bddad; no voters:
I20260812 16:42:06.471829 26270 raft_consensus.cc:2781] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:06.471908 26270 raft_consensus.cc:482] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:06.471939 26270 raft_consensus.cc:3037] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.472795 26270 raft_consensus.cc:504] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.472967 26270 leader_election.cc:288] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703), e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.473140 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b297c8bdd34473bd90a926d25f5890" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2"
I20260812 16:42:06.473269 25839 raft_consensus.cc:3037] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.473331 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b297c8bdd34473bd90a926d25f5890" candidate_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4ae5164479f42e1a96348e4a95bddad"
I20260812 16:42:06.473420 26110 raft_consensus.cc:3037] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.473932 25839 raft_consensus.cc:2454] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 1.
I20260812 16:42:06.474079 26110 raft_consensus.cc:2454] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fdd0c3b7db443d980930da4f9fec1b0 in term 1.
I20260812 16:42:06.474169 25476 leader_election.cc:302] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, 7fdd0c3b7db443d980930da4f9fec1b0; no voters:
I20260812 16:42:06.474272 26270 raft_consensus.cc:2781] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:06.474337 26270 raft_consensus.cc:686] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Running, Role: LEADER
I20260812 16:42:06.474375 26270 consensus_queue.cc:237] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.474741 26276 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: TxnStatusTablet state changed. Reason: New leader 7fdd0c3b7db443d980930da4f9fec1b0. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.474841 26276 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:06.475070 26293 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 16:42:06.475068 25305 catalog_manager.cc:5495] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:06.475210 26293 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 16:42:06.487926 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.484189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.0.0.1:44918)
0812 16:42:06.484342 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.484353 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.484424 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.484622 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.484623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.484624 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:06.484682 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.484684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.485341 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.485342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.485991 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.485994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.487325 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.487326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.487394 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.487411 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.487728 (+ 317us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.487735 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.487785 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.487840 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 16:42:06.488008 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.484250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44918 (local address 127.21.114.65:41171)
0812 16:42:06.484294 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.484321 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.484404 (+ 83us) server_negotiation.cc:407] Connection header received
0812 16:42:06.484501 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.484502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.484522 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.484615 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:06.484738 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.485229 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.486896 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.487201 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.487280 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.487514 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.487633 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.487703 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.487832 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.487862 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:06.492534 26110 raft_consensus.cc:1261] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Refusing update from remote peer 7fdd0c3b7db443d980930da4f9fec1b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:06.492937 26270 consensus_queue.cc:1035] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:06.493944 25839 raft_consensus.cc:1261] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Refusing update from remote peer 7fdd0c3b7db443d980930da4f9fec1b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:06.494386 26276 consensus_queue.cc:1035] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:06.494724 26264 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: TxnStatusTablet state changed. Reason: New leader 7fdd0c3b7db443d980930da4f9fec1b0. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.494849 26264 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:06.496080 26262 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: TxnStatusTablet state changed. Reason: New leader 7fdd0c3b7db443d980930da4f9fec1b0. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.496201 26262 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:06.496790 26270 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.496883 26270 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:06.496950 26270 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.497004 26270 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 7fdd0c3b7db443d980930da4f9fec1b0: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:06.497068 26306 mvcc.cc:205] Tried to move back new op lower bound from 7317720786909978624 to 7317720786839572480. Current Snapshot: MvccSnapshot[applied={T|T < 7317720786909978624}]
I20260812 16:42:06.497146 26264 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.497227 26264 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P e4ae5164479f42e1a96348e4a95bddad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:06.497655 26262 tablet_replica.cc:439] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } } }
I20260812 16:42:06.497751 26262 tablet_replica.cc:442] T e7b297c8bdd34473bd90a926d25f5890 P 0ca1c4015e144e52bbb19f7fff212da2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:06.497876 26308 mvcc.cc:205] Tried to move back new op lower bound from 7317720786909978624 to 7317720786839572480. Current Snapshot: MvccSnapshot[applied={T|T < 7317720786909978624 or (T in {7317720786909978624})}]
I20260812 16:42:06.503125 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.500175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.21.114.65:41171)
0812 16:42:06.500240 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.500243 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.500251 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:06.500275 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.500276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.500285 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.500355 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:06.500543 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.501296 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.502439 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.502647 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.502724 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.502876 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.502910 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.502962 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.503023 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.503043 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 16:42:06.516599 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.513249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53779 (local address 127.21.114.65:41171)
0812 16:42:06.513315 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.513318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.513409 (+ 91us) server_negotiation.cc:407] Connection header received
0812 16:42:06.513504 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.513505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.513515 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.513558 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:06.513781 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.514538 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.515665 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.515979 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.516056 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.516332 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.516367 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.516418 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.516503 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.516524 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:42:06.516868 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.513161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.21.114.65:53779)
0812 16:42:06.513343 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.513355 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.513435 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.513635 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.513636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.513637 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:06.513709 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.513711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.514632 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.514633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.515586 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.515590 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.516089 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.516090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.516175 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.516202 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.516438 (+ 236us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.516439 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.516736 (+ 297us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.516783 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":72,"threads_started":1}
I20260812 16:42:06.519245 25839 raft_consensus.cc:1261] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Refusing update from remote peer 7fdd0c3b7db443d980930da4f9fec1b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:06.519485 26276 consensus_queue.cc:1035] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:06.519526 26110 raft_consensus.cc:1261] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Refusing update from remote peer 7fdd0c3b7db443d980930da4f9fec1b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:06.519801 26276 consensus_queue.cc:1035] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:06.535593 25307 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:06.535715 25307 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:06.536549 25307 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Sending DeleteTablet for 3 replicas of tablet 3adc7cbb97314735a30f69fffdbb75b0
I20260812 16:42:06.536872 25560 tablet_service.cc:1514] Processing DeleteTablet for tablet 3adc7cbb97314735a30f69fffdbb75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:06 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:44902
I20260812 16:42:06.536906 26072 tablet_service.cc:1514] Processing DeleteTablet for tablet 3adc7cbb97314735a30f69fffdbb75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:06 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52392
I20260812 16:42:06.537129 25800 tablet_service.cc:1514] Processing DeleteTablet for tablet 3adc7cbb97314735a30f69fffdbb75b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:06 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:33270
I20260812 16:42:06.537124 25307 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:06.537254 25307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:06.537350 26338 tablet_replica.cc:330] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: stopping tablet replica
I20260812 16:42:06.537456 26338 raft_consensus.cc:2229] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:06.537563 26341 tablet_replica.cc:330] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: stopping tablet replica
I20260812 16:42:06.537592 26338 raft_consensus.cc:2258] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:06.538195 26338 ts_tablet_manager.cc:1905] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:06.538491 26341 raft_consensus.cc:2229] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:06.538491 26072 tablet_service.cc:1467] Processing CreateTablet for tablet f8c740e61e7f409db6465b0d334ced90 (DEFAULT_TABLE table=test-table [id=b1e260b12db04159bcbfc8fae0d68abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:06.538528 25560 tablet_service.cc:1467] Processing CreateTablet for tablet f8c740e61e7f409db6465b0d334ced90 (DEFAULT_TABLE table=test-table [id=b1e260b12db04159bcbfc8fae0d68abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:06.538573 26341 raft_consensus.cc:2258] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:06.538616 26072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c740e61e7f409db6465b0d334ced90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.538658 25560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c740e61e7f409db6465b0d334ced90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.538738 26339 tablet_replica.cc:330] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: stopping tablet replica
I20260812 16:42:06.538828 26339 raft_consensus.cc:2229] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:06.538874 26339 raft_consensus.cc:2258] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:06.540024 26255 tablet_bootstrap.cc:492] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Bootstrap starting.
I20260812 16:42:06.540086 25800 tablet_service.cc:1467] Processing CreateTablet for tablet f8c740e61e7f409db6465b0d334ced90 (DEFAULT_TABLE table=test-table [id=b1e260b12db04159bcbfc8fae0d68abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:06.540199 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c740e61e7f409db6465b0d334ced90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:06.540495 26255 tablet_bootstrap.cc:654] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.541255 26339 ts_tablet_manager.cc:1905] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:06.541290 26255 tablet_bootstrap.cc:492] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: No bootstrap required, opened a new log
I20260812 16:42:06.541323 26255 ts_tablet_manager.cc:1397] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:06.541500 26255 raft_consensus.cc:348] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.541566 26255 raft_consensus.cc:374] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.541564 26253 tablet_bootstrap.cc:492] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Bootstrap starting.
I20260812 16:42:06.541586 26255 raft_consensus.cc:729] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.541627 26255 consensus_queue.cc:260] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.541716 26255 ts_tablet_manager.cc:1428] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:06.542026 26253 tablet_bootstrap.cc:654] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.542356 26256 tablet_bootstrap.cc:492] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Bootstrap starting.
I20260812 16:42:06.542726 26256 tablet_bootstrap.cc:654] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:06.543465 26341 ts_tablet_manager.cc:1905] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:06.544101 26339 ts_tablet_manager.cc:1918] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:06.544193 26339 log.cc:1196] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/3adc7cbb97314735a30f69fffdbb75b0
I20260812 16:42:06.544548 26339 ts_tablet_manager.cc:1939] T 3adc7cbb97314735a30f69fffdbb75b0 P e4ae5164479f42e1a96348e4a95bddad: Deleting consensus metadata
I20260812 16:42:06.545061 25280 catalog_manager.cc:4841] TS e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799): tablet 3adc7cbb97314735a30f69fffdbb75b0 (table test-table [id=e4bec179c712405d93976e3645f678f9]) successfully deleted
I20260812 16:42:06.545279 26341 ts_tablet_manager.cc:1918] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:06.545343 26341 log.cc:1196] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/3adc7cbb97314735a30f69fffdbb75b0
I20260812 16:42:06.545585 26341 ts_tablet_manager.cc:1939] T 3adc7cbb97314735a30f69fffdbb75b0 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting consensus metadata
I20260812 16:42:06.546001 25281 catalog_manager.cc:4841] TS 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703): tablet 3adc7cbb97314735a30f69fffdbb75b0 (table test-table [id=e4bec179c712405d93976e3645f678f9]) successfully deleted
I20260812 16:42:06.548689 26253 tablet_bootstrap.cc:492] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: No bootstrap required, opened a new log
I20260812 16:42:06.548755 26253 ts_tablet_manager.cc:1397] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260812 16:42:06.548908 26253 raft_consensus.cc:348] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.549000 26253 raft_consensus.cc:374] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.549021 26253 raft_consensus.cc:729] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.549060 26253 consensus_queue.cc:260] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.549147 26253 ts_tablet_manager.cc:1428] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:06.550961 26338 ts_tablet_manager.cc:1918] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:06.551302 26338 log.cc:1196] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/3adc7cbb97314735a30f69fffdbb75b0
I20260812 16:42:06.551429 26256 tablet_bootstrap.cc:492] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: No bootstrap required, opened a new log
I20260812 16:42:06.551489 26256 ts_tablet_manager.cc:1397] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260812 16:42:06.551640 26256 raft_consensus.cc:348] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.551728 26256 raft_consensus.cc:374] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:06.551775 26256 raft_consensus.cc:729] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca1c4015e144e52bbb19f7fff212da2, State: Initialized, Role: FOLLOWER
I20260812 16:42:06.551709 26338 ts_tablet_manager.cc:1939] T 3adc7cbb97314735a30f69fffdbb75b0 P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting consensus metadata
I20260812 16:42:06.551828 26256 consensus_queue.cc:260] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.551937 26256 ts_tablet_manager.cc:1428] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:06.554930 25281 catalog_manager.cc:4841] TS 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171): tablet 3adc7cbb97314735a30f69fffdbb75b0 (table test-table [id=e4bec179c712405d93976e3645f678f9]) successfully deleted
I20260812 16:42:06.578315 26262 raft_consensus.cc:482] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:06.578418 26262 raft_consensus.cc:504] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.578787 26262 leader_election.cc:288] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171), e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.582652 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.579091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:48725 (local address 127.21.114.65:41171)
0812 16:42:06.579137 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.579139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.579154 (+ 15us) server_negotiation.cc:407] Connection header received
0812 16:42:06.579281 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.579283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.579295 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.579326 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.579635 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.580278 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.581788 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.582317 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.582406 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.582419 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.582545 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.582583 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:06.582667 26347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.578922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.21.114.66:48725)
0812 16:42:06.579084 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.579097 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.579187 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.579430 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.579431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.579437 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.579540 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.579541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.580418 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.580420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.581673 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.581677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.582403 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.582404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.582460 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.582464 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.582536 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.582581 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":24,"thread_start_us":68,"threads_started":1}
I20260812 16:42:06.583279 25600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c740e61e7f409db6465b0d334ced90" candidate_uuid: "0ca1c4015e144e52bbb19f7fff212da2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" is_pre_election: true
I20260812 16:42:06.583338 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.579220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:53195 (local address 127.21.114.67:45799)
0812 16:42:06.579265 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.579267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.579276 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:06.579338 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.579339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.579351 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.579415 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:06.579619 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.580376 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.582460 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.583007 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.583095 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.583104 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.583230 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.583276 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:06.583391 25600 raft_consensus.cc:2454] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ca1c4015e144e52bbb19f7fff212da2 in term 0.
I20260812 16:42:06.583344 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.579036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:45799 (local address 127.21.114.66:53195)
0812 16:42:06.579229 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.579239 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.579280 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.579431 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.579431 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.579433 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:06.579540 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.579541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.580501 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.580502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.581673 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.581677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.583095 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.583096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.583143 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.583147 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.583222 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.583260 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":19,"thread_start_us":57,"threads_started":1}
I20260812 16:42:06.583631 25726 leader_election.cc:302] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, 7fdd0c3b7db443d980930da4f9fec1b0; no voters:
I20260812 16:42:06.583775 26262 raft_consensus.cc:2781] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:06.583813 26262 raft_consensus.cc:482] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:06.583841 26262 raft_consensus.cc:3037] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.583947 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c740e61e7f409db6465b0d334ced90" candidate_uuid: "0ca1c4015e144e52bbb19f7fff212da2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4ae5164479f42e1a96348e4a95bddad" is_pre_election: true
I20260812 16:42:06.584034 26110 raft_consensus.cc:2454] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ca1c4015e144e52bbb19f7fff212da2 in term 0.
I20260812 16:42:06.584697 26262 raft_consensus.cc:504] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.584846 26262 leader_election.cc:288] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [CANDIDATE]: Term 1 election: Requested vote from peers 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171), e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799)
I20260812 16:42:06.585026 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c740e61e7f409db6465b0d334ced90" candidate_uuid: "0ca1c4015e144e52bbb19f7fff212da2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4ae5164479f42e1a96348e4a95bddad"
I20260812 16:42:06.585107 26110 raft_consensus.cc:3037] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.585822 26110 raft_consensus.cc:2454] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ca1c4015e144e52bbb19f7fff212da2 in term 1.
I20260812 16:42:06.586036 25600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c740e61e7f409db6465b0d334ced90" candidate_uuid: "0ca1c4015e144e52bbb19f7fff212da2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fdd0c3b7db443d980930da4f9fec1b0"
I20260812 16:42:06.586076 25724 leader_election.cc:302] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, e4ae5164479f42e1a96348e4a95bddad; no voters:
I20260812 16:42:06.586131 25600 raft_consensus.cc:3037] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:06.586165 26262 raft_consensus.cc:2781] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:06.586270 26262 raft_consensus.cc:686] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 LEADER]: Becoming Leader. State: Replica: 0ca1c4015e144e52bbb19f7fff212da2, State: Running, Role: LEADER
I20260812 16:42:06.586340 26262 consensus_queue.cc:237] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:06.587008 25600 raft_consensus.cc:2454] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ca1c4015e144e52bbb19f7fff212da2 in term 1.
I20260812 16:42:06.586984 25307 catalog_manager.cc:5495] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "0ca1c4015e144e52bbb19f7fff212da2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:06.601753 26252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.599089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33276 (local address 127.21.114.66:46703)
0812 16:42:06.599129 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.599131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.599157 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:42:06.599194 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.599195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.599219 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.599300 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:06.599387 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.600103 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.600880 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.601191 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.601271 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.601373 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.601507 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.601591 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.601610 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.601635 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:42:06.607071 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.604412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:45711 (local address 127.21.114.65:41171)
0812 16:42:06.604452 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.604453 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.604587 (+ 134us) server_negotiation.cc:407] Connection header received
0812 16:42:06.604642 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.604643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.604651 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.604697 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:06.604823 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.605305 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.606390 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.606570 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.606619 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.606837 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.606863 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.606901 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.606960 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.606978 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:42:06.607266 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.604348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.21.114.66:45711)
0812 16:42:06.604512 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.604523 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.604583 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.604701 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.604702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.604703 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:06.604769 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.604771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.605393 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.605394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.606302 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.606305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.606650 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.606651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.606723 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.606739 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.606904 (+ 165us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.606905 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.606956 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.607002 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260812 16:42:06.609661 26110 raft_consensus.cc:1261] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Refusing update from remote peer 0ca1c4015e144e52bbb19f7fff212da2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:06.609687 25600 raft_consensus.cc:1261] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Refusing update from remote peer 0ca1c4015e144e52bbb19f7fff212da2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:06.609932 26262 consensus_queue.cc:1035] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:06.610064 26351 consensus_queue.cc:1035] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:06.612188 26305 mvcc.cc:205] Tried to move back new op lower bound from 7317720787391352832 to 7317720787298254848. Current Snapshot: MvccSnapshot[applied={T|T < 7317720787391352832}]
I20260812 16:42:06.618245 26252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.615905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:33017 (local address 127.21.114.66:46703)
0812 16:42:06.615953 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:06.615954 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:06.615961 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:42:06.615979 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:06.615980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:06.615988 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:06.616062 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:06.616216 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.616742 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.617543 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.617825 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.617888 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.618042 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.618068 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.618109 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:06.618184 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 16:42:06.618198 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 16:42:06.618301 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:06.615733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:46703 (local address 127.21.114.65:33017)
0812 16:42:06.615783 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:06.615795 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:06.615834 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:06.616112 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:06.616113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:06.616114 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:06.616158 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.616160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.616827 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.616828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.617459 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:06.617462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:06.617900 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:06.617901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:06.617968 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:06.617975 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:06.618129 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:06.618130 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:06.618180 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 16:42:06.618224 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 16:42:06.618602 26308 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 16:42:08.144745 25304 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:08.144853 25304 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:08.145766 25304 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Sending DeleteTablet for 3 replicas of tablet f8c740e61e7f409db6465b0d334ced90
I20260812 16:42:08.146006 25560 tablet_service.cc:1514] Processing DeleteTablet for tablet f8c740e61e7f409db6465b0d334ced90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:08 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:44902
I20260812 16:42:08.146041 26072 tablet_service.cc:1514] Processing DeleteTablet for tablet f8c740e61e7f409db6465b0d334ced90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:08 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52392
I20260812 16:42:08.146092 25800 tablet_service.cc:1514] Processing DeleteTablet for tablet f8c740e61e7f409db6465b0d334ced90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:08 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:33270
I20260812 16:42:08.146262 26412 tablet_replica.cc:330] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: stopping tablet replica
I20260812 16:42:08.146271 26410 tablet_replica.cc:330] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: stopping tablet replica
I20260812 16:42:08.146320 26410 raft_consensus.cc:2229] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:08.146320 26412 raft_consensus.cc:2229] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:08.146355 26410 raft_consensus.cc:2258] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:08.146368 26409 tablet_replica.cc:330] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: stopping tablet replica
I20260812 16:42:08.146420 26412 raft_consensus.cc:2258] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:08.146641 26410 ts_tablet_manager.cc:1905] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:08.146778 26412 ts_tablet_manager.cc:1905] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:08.146433 26409 raft_consensus.cc:2229] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:08.147084 26409 raft_consensus.cc:2258] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:08.147328 26409 ts_tablet_manager.cc:1905] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:08.148526 26412 ts_tablet_manager.cc:1918] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 16:42:08.148522 26410 ts_tablet_manager.cc:1918] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 16:42:08.148589 26412 log.cc:1196] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/f8c740e61e7f409db6465b0d334ced90
I20260812 16:42:08.148685 26410 log.cc:1196] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/f8c740e61e7f409db6465b0d334ced90
I20260812 16:42:08.148864 26412 ts_tablet_manager.cc:1939] T f8c740e61e7f409db6465b0d334ced90 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting consensus metadata
I20260812 16:42:08.149031 26410 ts_tablet_manager.cc:1939] T f8c740e61e7f409db6465b0d334ced90 P e4ae5164479f42e1a96348e4a95bddad: Deleting consensus metadata
I20260812 16:42:08.149183 25281 catalog_manager.cc:4841] TS 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703): tablet f8c740e61e7f409db6465b0d334ced90 (table test-table [id=b1e260b12db04159bcbfc8fae0d68abc]) successfully deleted
I20260812 16:42:08.149364 25280 catalog_manager.cc:4841] TS e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799): tablet f8c740e61e7f409db6465b0d334ced90 (table test-table [id=b1e260b12db04159bcbfc8fae0d68abc]) successfully deleted
I20260812 16:42:08.149494 26409 ts_tablet_manager.cc:1918] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 16:42:08.149551 26409 log.cc:1196] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/f8c740e61e7f409db6465b0d334ced90
I20260812 16:42:08.149718 26409 ts_tablet_manager.cc:1939] T f8c740e61e7f409db6465b0d334ced90 P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting consensus metadata
I20260812 16:42:08.150178 25281 catalog_manager.cc:4841] TS 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171): tablet f8c740e61e7f409db6465b0d334ced90 (table test-table [id=b1e260b12db04159bcbfc8fae0d68abc]) successfully deleted
Aug 12 16:42:08 dist-test-slave-45dx krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552928, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 16:42:08 dist-test-slave-45dx krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552928, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:08.172678 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.165211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.21.114.126:32987)
0812 16:42:08.165356 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:08.165358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:08.165369 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:08.165398 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:08.165399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:08.165410 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:08.165479 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:08.166019 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.166621 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.167382 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.167639 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.167724 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.170086 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:08.170088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:08.170088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:08.170095 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:08.171658 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:08.171969 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:08.171970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:08.171970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:08.172027 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:08.172190 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:08.172190 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:08.172191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:08.172295 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:08.172454 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:08.172540 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 16:42:08.172606 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":92,"threads_started":1}
I20260812 16:42:08.174206 25304 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:08.174386 25304 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:08.175808 25560 tablet_service.cc:1467] Processing CreateTablet for tablet 408beff4630e4f43be4b3907139b518e (DEFAULT_TABLE table=test-table [id=93365db27cfa4a0eba69f21fc40e8b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:08.175810 25800 tablet_service.cc:1467] Processing CreateTablet for tablet 408beff4630e4f43be4b3907139b518e (DEFAULT_TABLE table=test-table [id=93365db27cfa4a0eba69f21fc40e8b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:08.175841 26072 tablet_service.cc:1467] Processing CreateTablet for tablet 408beff4630e4f43be4b3907139b518e (DEFAULT_TABLE table=test-table [id=93365db27cfa4a0eba69f21fc40e8b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:08.175982 25560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408beff4630e4f43be4b3907139b518e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:08.175981 26072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408beff4630e4f43be4b3907139b518e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:08.175984 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408beff4630e4f43be4b3907139b518e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:08.177448 26428 tablet_bootstrap.cc:492] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Bootstrap starting.
I20260812 16:42:08.177448 26427 tablet_bootstrap.cc:492] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Bootstrap starting.
I20260812 16:42:08.177659 26429 tablet_bootstrap.cc:492] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Bootstrap starting.
I20260812 16:42:08.177874 26427 tablet_bootstrap.cc:654] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:08.177910 26428 tablet_bootstrap.cc:654] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:08.178124 26429 tablet_bootstrap.cc:654] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:08.178648 26428 tablet_bootstrap.cc:492] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: No bootstrap required, opened a new log
I20260812 16:42:08.178711 26428 ts_tablet_manager.cc:1397] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:08.178730 26427 tablet_bootstrap.cc:492] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: No bootstrap required, opened a new log
I20260812 16:42:08.178773 26427 ts_tablet_manager.cc:1397] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:08.178856 26428 raft_consensus.cc:348] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.178934 26428 raft_consensus.cc:374] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:08.178896 26427 raft_consensus.cc:348] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.178956 26428 raft_consensus.cc:729] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Initialized, Role: FOLLOWER
I20260812 16:42:08.178975 26427 raft_consensus.cc:374] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:08.179000 26427 raft_consensus.cc:729] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca1c4015e144e52bbb19f7fff212da2, State: Initialized, Role: FOLLOWER
I20260812 16:42:08.179025 26429 tablet_bootstrap.cc:492] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: No bootstrap required, opened a new log
I20260812 16:42:08.179031 26428 consensus_queue.cc:260] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.179045 26427 consensus_queue.cc:260] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.179121 26429 ts_tablet_manager.cc:1397] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:08.179148 26427 ts_tablet_manager.cc:1428] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:08.179203 26428 ts_tablet_manager.cc:1428] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:08.179283 26429 raft_consensus.cc:348] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.179378 26429 raft_consensus.cc:374] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:08.179409 26429 raft_consensus.cc:729] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:08.179469 26429 consensus_queue.cc:260] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.179638 26429 ts_tablet_manager.cc:1428] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:08.301031 26437 raft_consensus.cc:482] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:08.301138 26437 raft_consensus.cc:504] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.301474 26437 leader_election.cc:288] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171), 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703)
I20260812 16:42:08.304941 26441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.301937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:46703 (local address 127.21.114.67:59741)
0812 16:42:08.302092 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:08.302104 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:08.302157 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:08.302403 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:08.302404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:08.302407 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:08.302481 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.302483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.303136 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.303137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.304000 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.304003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.304643 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.304644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.304732 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.304737 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:08.304796 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 16:42:08.304849 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260812 16:42:08.304965 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.302075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:59741 (local address 127.21.114.66:46703)
0812 16:42:08.302260 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:08.302262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:08.302270 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:08.302296 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:08.302297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:08.302309 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:08.302384 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:08.302558 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.303045 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.304104 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.304557 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.304617 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.304624 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:08.304809 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 16:42:08.304857 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":105,"threads_started":1}
I20260812 16:42:08.305049 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.301665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.21.114.67:53195)
0812 16:42:08.301867 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:08.301880 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:08.301949 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:08.302184 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:08.302185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:08.302188 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:08.302254 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.302256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.303079 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.303080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.303956 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.303958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.304781 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.304782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.304862 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.304867 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:08.304929 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 16:42:08.304969 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":144,"threads_started":1}
I20260812 16:42:08.305401 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408beff4630e4f43be4b3907139b518e" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2" is_pre_election: true
I20260812 16:42:08.305507 25839 raft_consensus.cc:2454] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 0.
I20260812 16:42:08.305475 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.301783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:53195 (local address 127.21.114.65:41171)
0812 16:42:08.301983 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:08.301986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:08.301998 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:42:08.302041 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:08.302042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:08.302056 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:08.302162 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:08.302343 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.302988 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.304055 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.304675 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.304768 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.304779 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:08.304957 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 16:42:08.305013 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":130,"threads_started":1}
I20260812 16:42:08.305685 25996 leader_election.cc:302] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, e4ae5164479f42e1a96348e4a95bddad; no voters:
I20260812 16:42:08.305721 25600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408beff4630e4f43be4b3907139b518e" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" is_pre_election: true
I20260812 16:42:08.305820 26437 raft_consensus.cc:2781] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:08.305859 26437 raft_consensus.cc:482] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:08.305856 25600 raft_consensus.cc:2454] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 0.
I20260812 16:42:08.305884 26437 raft_consensus.cc:3037] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:08.306632 26437 raft_consensus.cc:504] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.306773 26437 leader_election.cc:288] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 election: Requested vote from peers 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171), 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703)
I20260812 16:42:08.306969 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408beff4630e4f43be4b3907139b518e" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2"
I20260812 16:42:08.307045 25839 raft_consensus.cc:3037] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:08.307726 25839 raft_consensus.cc:2454] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 1.
I20260812 16:42:08.307878 25600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408beff4630e4f43be4b3907139b518e" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fdd0c3b7db443d980930da4f9fec1b0"
I20260812 16:42:08.307895 25996 leader_election.cc:302] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, e4ae5164479f42e1a96348e4a95bddad; no voters:
I20260812 16:42:08.307960 25600 raft_consensus.cc:3037] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:08.308079 26437 raft_consensus.cc:2781] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:08.308238 26437 raft_consensus.cc:686] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 1 LEADER]: Becoming Leader. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Running, Role: LEADER
I20260812 16:42:08.308341 26437 consensus_queue.cc:237] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.308899 25600 raft_consensus.cc:2454] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 1.
I20260812 16:42:08.309157 25304 catalog_manager.cc:5495] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad reported cstate change: term changed from 0 to 1, leader changed from <none> to e4ae5164479f42e1a96348e4a95bddad (127.21.114.67). New cstate: current_term: 1 leader_uuid: "e4ae5164479f42e1a96348e4a95bddad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:08.327224 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.324574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.21.114.67:45799)
0812 16:42:08.324729 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:08.324730 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:08.324736 (+ 6us) server_negotiation.cc:407] Connection header received
0812 16:42:08.324768 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:08.324769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:08.324787 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:08.324879 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:08.325044 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.325551 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.326324 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.326561 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.326641 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.326843 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:08.326970 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:08.327059 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:08.327101 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 16:42:08.327123 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260812 16:42:08.332073 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.329793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:44825 (local address 127.21.114.65:41171)
0812 16:42:08.329849 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:08.329851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:08.329860 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:08.329936 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:08.329936 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:08.329946 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:08.330018 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:08.330152 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.330607 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.331361 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.331558 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.331637 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.331814 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:08.331850 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:08.331909 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:08.331972 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 16:42:08.331995 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 16:42:08.332130 26453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.329641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.21.114.67:44825)
0812 16:42:08.329805 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:08.329817 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:08.329871 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:08.330021 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:08.330021 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:08.330023 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:08.330085 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.330086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.330689 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.330690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.331268 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.331270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.331635 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.331636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.331703 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.331721 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:08.331924 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:08.331926 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:08.331970 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 16:42:08.332015 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260812 16:42:08.334438 25839 raft_consensus.cc:1261] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Refusing update from remote peer e4ae5164479f42e1a96348e4a95bddad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:08.334453 25600 raft_consensus.cc:1261] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Refusing update from remote peer e4ae5164479f42e1a96348e4a95bddad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:08.334715 26437 consensus_queue.cc:1035] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:08.334861 26445 consensus_queue.cc:1035] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:08.342454 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.340001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:60417 (local address 127.21.114.67:45799)
0812 16:42:08.340070 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:08.340072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:08.340186 (+ 114us) server_negotiation.cc:407] Connection header received
0812 16:42:08.340273 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:08.340273 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:08.340283 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:08.340376 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:08.340471 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.340927 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.341806 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.342096 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.342159 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.342287 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:08.342311 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:08.342349 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:08.342380 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 16:42:08.342396 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:08.342468 26464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:08.339934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:45799 (local address 127.21.114.65:60417)
0812 16:42:08.340125 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:08.340134 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:08.340199 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:08.340388 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:08.340389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:08.340390 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:08.340431 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.340432 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.340995 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.340995 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.341714 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:08.341717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:08.342175 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:08.342175 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:08.342219 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:08.342223 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:08.342347 (+ 124us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:08.342348 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:08.342377 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 16:42:08.342410 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":105,"threads_started":1}
I20260812 16:42:08.351989 25307 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:08.352120 25307 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:08.352815 25307 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Sending DeleteTablet for 3 replicas of tablet 408beff4630e4f43be4b3907139b518e
I20260812 16:42:08.353065 25560 tablet_service.cc:1514] Processing DeleteTablet for tablet 408beff4630e4f43be4b3907139b518e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:08 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:44902
I20260812 16:42:08.353098 25800 tablet_service.cc:1514] Processing DeleteTablet for tablet 408beff4630e4f43be4b3907139b518e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:08 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:33270
I20260812 16:42:08.353165 26409 tablet_replica.cc:330] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: stopping tablet replica
I20260812 16:42:08.353144 26072 tablet_service.cc:1514] Processing DeleteTablet for tablet 408beff4630e4f43be4b3907139b518e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:08 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52392
I20260812 16:42:08.353226 26409 raft_consensus.cc:2229] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:08.353245 26412 tablet_replica.cc:330] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: stopping tablet replica
I20260812 16:42:08.353261 26409 raft_consensus.cc:2258] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:08.353299 26412 raft_consensus.cc:2229] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:08.353343 26412 raft_consensus.cc:2258] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:08.353418 26410 tablet_replica.cc:330] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: stopping tablet replica
I20260812 16:42:08.353469 26410 raft_consensus.cc:2229] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:08.353554 26410 raft_consensus.cc:2258] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:08.353597 26409 ts_tablet_manager.cc:1905] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:08.353765 25307 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:08.353897 25307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:08.353974 26412 ts_tablet_manager.cc:1905] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:08.355189 26409 ts_tablet_manager.cc:1918] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:08.355250 26409 log.cc:1196] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/408beff4630e4f43be4b3907139b518e
I20260812 16:42:08.355479 26409 ts_tablet_manager.cc:1939] T 408beff4630e4f43be4b3907139b518e P 7fdd0c3b7db443d980930da4f9fec1b0: Deleting consensus metadata
I20260812 16:42:08.355743 26410 ts_tablet_manager.cc:1905] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:08.355767 26412 ts_tablet_manager.cc:1918] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:08.355818 26412 log.cc:1196] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/408beff4630e4f43be4b3907139b518e
I20260812 16:42:08.356047 26412 ts_tablet_manager.cc:1939] T 408beff4630e4f43be4b3907139b518e P 0ca1c4015e144e52bbb19f7fff212da2: Deleting consensus metadata
I20260812 16:42:08.356650 25281 catalog_manager.cc:4841] TS 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703): tablet 408beff4630e4f43be4b3907139b518e (table test-table [id=93365db27cfa4a0eba69f21fc40e8b50]) successfully deleted
I20260812 16:42:08.356735 25281 catalog_manager.cc:4841] TS 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171): tablet 408beff4630e4f43be4b3907139b518e (table test-table [id=93365db27cfa4a0eba69f21fc40e8b50]) successfully deleted
I20260812 16:42:08.356734 25800 tablet_service.cc:1467] Processing CreateTablet for tablet ed14fac3ad96403797ba499eb7a6ed41 (DEFAULT_TABLE table=test-table [id=049b17e98b8840108753a5e4c8f29b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:08.356832 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed14fac3ad96403797ba499eb7a6ed41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:08.356854 25560 tablet_service.cc:1467] Processing CreateTablet for tablet ed14fac3ad96403797ba499eb7a6ed41 (DEFAULT_TABLE table=test-table [id=049b17e98b8840108753a5e4c8f29b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:08.356936 25560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed14fac3ad96403797ba499eb7a6ed41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:08.357340 26410 ts_tablet_manager.cc:1918] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:08.357393 26410 log.cc:1196] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/408beff4630e4f43be4b3907139b518e
I20260812 16:42:08.357612 26410 ts_tablet_manager.cc:1939] T 408beff4630e4f43be4b3907139b518e P e4ae5164479f42e1a96348e4a95bddad: Deleting consensus metadata
I20260812 16:42:08.357836 26072 tablet_service.cc:1467] Processing CreateTablet for tablet ed14fac3ad96403797ba499eb7a6ed41 (DEFAULT_TABLE table=test-table [id=049b17e98b8840108753a5e4c8f29b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:08.357939 26072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed14fac3ad96403797ba499eb7a6ed41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:08.358075 26427 tablet_bootstrap.cc:492] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Bootstrap starting.
I20260812 16:42:08.358075 26429 tablet_bootstrap.cc:492] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0: Bootstrap starting.
I20260812 16:42:08.358371 26427 tablet_bootstrap.cc:654] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:08.358378 26429 tablet_bootstrap.cc:654] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:08.359035 26428 tablet_bootstrap.cc:492] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Bootstrap starting.
I20260812 16:42:08.359207 26427 tablet_bootstrap.cc:492] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: No bootstrap required, opened a new log
I20260812 16:42:08.359254 26427 ts_tablet_manager.cc:1397] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:08.359287 26429 tablet_bootstrap.cc:492] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0: No bootstrap required, opened a new log
I20260812 16:42:08.359324 26429 ts_tablet_manager.cc:1397] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:08.359365 26427 raft_consensus.cc:348] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.359413 26428 tablet_bootstrap.cc:654] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:08.359429 26427 raft_consensus.cc:374] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:08.359452 26427 raft_consensus.cc:729] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca1c4015e144e52bbb19f7fff212da2, State: Initialized, Role: FOLLOWER
I20260812 16:42:08.359423 26429 raft_consensus.cc:348] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.359488 26429 raft_consensus.cc:374] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:08.359512 26429 raft_consensus.cc:729] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fdd0c3b7db443d980930da4f9fec1b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:08.359495 26427 consensus_queue.cc:260] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.359551 26429 consensus_queue.cc:260] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.359594 26427 ts_tablet_manager.cc:1428] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:08.359634 26429 ts_tablet_manager.cc:1428] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:08.360347 26428 tablet_bootstrap.cc:492] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: No bootstrap required, opened a new log
I20260812 16:42:08.360402 26428 ts_tablet_manager.cc:1397] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:08.360517 25280 catalog_manager.cc:4841] TS e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799): tablet 408beff4630e4f43be4b3907139b518e (table test-table [id=93365db27cfa4a0eba69f21fc40e8b50]) successfully deleted
I20260812 16:42:08.360544 26428 raft_consensus.cc:348] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.360613 26428 raft_consensus.cc:374] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:08.360651 26428 raft_consensus.cc:729] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Initialized, Role: FOLLOWER
I20260812 16:42:08.360697 26428 consensus_queue.cc:260] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.360805 26428 ts_tablet_manager.cc:1428] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:08.505498 26445 raft_consensus.cc:482] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:08.505652 26445 raft_consensus.cc:504] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.505817 26445 leader_election.cc:288] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171), 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703)
I20260812 16:42:08.506042 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed14fac3ad96403797ba499eb7a6ed41" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2" is_pre_election: true
I20260812 16:42:08.506116 25600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed14fac3ad96403797ba499eb7a6ed41" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" is_pre_election: true
I20260812 16:42:08.506174 25839 raft_consensus.cc:2454] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 0.
I20260812 16:42:08.506201 25600 raft_consensus.cc:2454] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 0.
I20260812 16:42:08.506345 25996 leader_election.cc:302] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, e4ae5164479f42e1a96348e4a95bddad; no voters:
I20260812 16:42:08.506464 26445 raft_consensus.cc:2781] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:08.506548 26445 raft_consensus.cc:482] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:08.506582 26445 raft_consensus.cc:3037] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:08.507355 26445 raft_consensus.cc:504] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.507512 26445 leader_election.cc:288] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 election: Requested vote from peers 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171), 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703)
I20260812 16:42:08.507687 25600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed14fac3ad96403797ba499eb7a6ed41" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fdd0c3b7db443d980930da4f9fec1b0"
I20260812 16:42:08.507726 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed14fac3ad96403797ba499eb7a6ed41" candidate_uuid: "e4ae5164479f42e1a96348e4a95bddad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ca1c4015e144e52bbb19f7fff212da2"
I20260812 16:42:08.507776 25600 raft_consensus.cc:3037] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:08.507804 25839 raft_consensus.cc:3037] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:08.508635 25600 raft_consensus.cc:2454] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 1.
I20260812 16:42:08.508635 25839 raft_consensus.cc:2454] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4ae5164479f42e1a96348e4a95bddad in term 1.
I20260812 16:42:08.508869 25996 leader_election.cc:302] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ca1c4015e144e52bbb19f7fff212da2, e4ae5164479f42e1a96348e4a95bddad; no voters:
I20260812 16:42:08.508953 26445 raft_consensus.cc:2781] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:08.509019 26445 raft_consensus.cc:686] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 1 LEADER]: Becoming Leader. State: Replica: e4ae5164479f42e1a96348e4a95bddad, State: Running, Role: LEADER
I20260812 16:42:08.509079 26445 consensus_queue.cc:237] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } }
I20260812 16:42:08.509761 25307 catalog_manager.cc:5495] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad reported cstate change: term changed from 0 to 1, leader changed from <none> to e4ae5164479f42e1a96348e4a95bddad (127.21.114.67). New cstate: current_term: 1 leader_uuid: "e4ae5164479f42e1a96348e4a95bddad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4ae5164479f42e1a96348e4a95bddad" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45799 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:08.547644 25600 raft_consensus.cc:1261] T ed14fac3ad96403797ba499eb7a6ed41 P 7fdd0c3b7db443d980930da4f9fec1b0 [term 1 FOLLOWER]: Refusing update from remote peer e4ae5164479f42e1a96348e4a95bddad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:08.547628 25839 raft_consensus.cc:1261] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Refusing update from remote peer e4ae5164479f42e1a96348e4a95bddad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:08.547904 26445 consensus_queue.cc:1035] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ca1c4015e144e52bbb19f7fff212da2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 46703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:08.548030 26437 consensus_queue.cc:1035] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fdd0c3b7db443d980930da4f9fec1b0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 16:42:08.552657 26381 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 16:42:10.072031 25305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:10.072140 25305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:10.073011 25305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a408b9e29c22433ab6990f78600a1ed4: Sending DeleteTablet for 3 replicas of tablet ed14fac3ad96403797ba499eb7a6ed41
I20260812 16:42:10.073292 26072 tablet_service.cc:1514] Processing DeleteTablet for tablet ed14fac3ad96403797ba499eb7a6ed41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:10 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52392
I20260812 16:42:10.073302 25560 tablet_service.cc:1514] Processing DeleteTablet for tablet ed14fac3ad96403797ba499eb7a6ed41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:10 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:44902
I20260812 16:42:10.073400 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25440
I20260812 16:42:10.073498 25800 tablet_service.cc:1514] Processing DeleteTablet for tablet ed14fac3ad96403797ba499eb7a6ed41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:10 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:33270
I20260812 16:42:10.082566 26535 tablet_replica.cc:330] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: stopping tablet replica
I20260812 16:42:10.082679 26535 raft_consensus.cc:2229] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:10.082732 26535 raft_consensus.cc:2258] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:10.082880 26530 tablet_replica.cc:330] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: stopping tablet replica
I20260812 16:42:10.082952 26530 raft_consensus.cc:2229] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:10.083032 26530 raft_consensus.cc:2258] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:10.083118 26535 ts_tablet_manager.cc:1905] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:10.083284 26530 ts_tablet_manager.cc:1905] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:10.084792 26535 ts_tablet_manager.cc:1918] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 16:42:10.084862 26535 log.cc:1196] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/ed14fac3ad96403797ba499eb7a6ed41
I20260812 16:42:10.085080 26535 ts_tablet_manager.cc:1939] T ed14fac3ad96403797ba499eb7a6ed41 P 0ca1c4015e144e52bbb19f7fff212da2: Deleting consensus metadata
I20260812 16:42:10.085397 25281 catalog_manager.cc:4841] TS 0ca1c4015e144e52bbb19f7fff212da2 (127.21.114.66:46703): tablet ed14fac3ad96403797ba499eb7a6ed41 (table test-table [id=049b17e98b8840108753a5e4c8f29b07]) successfully deleted
I20260812 16:42:10.085752 26530 ts_tablet_manager.cc:1918] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 16:42:10.085835 26530 log.cc:1196] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/ed14fac3ad96403797ba499eb7a6ed41
I20260812 16:42:10.086054 26530 ts_tablet_manager.cc:1939] T ed14fac3ad96403797ba499eb7a6ed41 P e4ae5164479f42e1a96348e4a95bddad: Deleting consensus metadata
I20260812 16:42:10.086447 25280 catalog_manager.cc:4841] TS e4ae5164479f42e1a96348e4a95bddad (127.21.114.67:45799): tablet ed14fac3ad96403797ba499eb7a6ed41 (table test-table [id=049b17e98b8840108753a5e4c8f29b07]) successfully deleted
W20260812 16:42:10.091480 25281 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:41171 (error 108)
I20260812 16:42:10.091804 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25699
I20260812 16:42:10.097942 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:10.091933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41171 (local address 127.0.0.1:44944)
0812 16:42:10.097835 (+ 5902us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:10.097897 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:41171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5865,"thread_start_us":67,"threads_started":1}
W20260812 16:42:10.098234 25281 catalog_manager.cc:4584] TS 7fdd0c3b7db443d980930da4f9fec1b0 (127.21.114.65:41171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed14fac3ad96403797ba499eb7a6ed41: Network error: Client connection negotiation failed: client connection to 127.21.114.65:41171: connect: Connection refused (error 111)
I20260812 16:42:10.109773 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25960
I20260812 16:42:10.126087 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25247
2026-08-12T16:42:10Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6032 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:10 dist-test-slave-45dx krb5kdc[26547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:10 dist-test-slave-45dx krb5kdc[26547](info): set up 2 sockets
Aug 12 16:42:10 dist-test-slave-45dx krb5kdc[26547](info): commencing operation
krb5kdc: starting...
W20260812 16:42:11.463209 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:11 dist-test-slave-45dx krb5kdc[26547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:11.589326 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33031
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33031
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:11.672719 26569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:11.672937 26569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:11.672960 26569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:11.674083 26569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:11.674121 26569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:11.674135 26569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:11.674147 26569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:11.674160 26569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:11.675556 26569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:11.675745 26569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:11.675926 26569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:11.681191 26578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:11.681196 26583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:11.681258 26569 server_base.cc:1034] running on GCE node
W20260812 16:42:11.681200 26579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:11.681670 26569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:11.682001 26569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:11.683156 26569 hybrid_clock.cc:648] HybridClock initialized: now 1786552931683141 us; error 32 us; skew 500 ppm
Aug 12 16:42:11 dist-test-slave-45dx krb5kdc[26547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552931, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:11.685828 26569 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:11.686225 26569 webserver.cc:460] Webserver started at http://127.21.114.126:38443/ using document root <none> and password file <none>
I20260812 16:42:11.686410 26569 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:11.686450 26569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:11.686538 26569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:11.687577 26569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "31dd0ad3c74241aab64ecb4d7b55bf44"
format_stamp: "Formatted at 2026-08-12 16:42:11 on dist-test-slave-45dx"
server_key: "0557d8f5ec7ab25141c8cf91f99139a8"
server_key_iv: "9a7008fa6662effded9c6ae00488d9d5"
server_key_version: "encryptionkey@0"
I20260812 16:42:11.687911 26569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "31dd0ad3c74241aab64ecb4d7b55bf44"
format_stamp: "Formatted at 2026-08-12 16:42:11 on dist-test-slave-45dx"
server_key: "0557d8f5ec7ab25141c8cf91f99139a8"
server_key_iv: "9a7008fa6662effded9c6ae00488d9d5"
server_key_version: "encryptionkey@0"
I20260812 16:42:11.689321 26569 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:11.690076 26593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:11.690275 26569 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:11.690364 26569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "31dd0ad3c74241aab64ecb4d7b55bf44"
format_stamp: "Formatted at 2026-08-12 16:42:11 on dist-test-slave-45dx"
server_key: "0557d8f5ec7ab25141c8cf91f99139a8"
server_key_iv: "9a7008fa6662effded9c6ae00488d9d5"
server_key_version: "encryptionkey@0"
I20260812 16:42:11.690430 26569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:11.703819 26569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:11.705783 26569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:11.705899 26569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:11.709856 26569 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33031
I20260812 16:42:11.709949 26701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33031 every 8 connection(s)
I20260812 16:42:11.710289 26569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:11.711252 26703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:11.713660 26703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44: Bootstrap starting.
I20260812 16:42:11.714247 26703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:11.714540 26703 log.cc:824] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:11.715170 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 26569
I20260812 16:42:11.715247 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:11.715335 26703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44: No bootstrap required, opened a new log
I20260812 16:42:11.715452 21961 external_mini_cluster.cc:1428] Setting key 2f7df2dfc650987b6be2e5bbd3bb1382
I20260812 16:42:11.717223 26703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33031 } }
I20260812 16:42:11.717386 26703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:11.717434 26703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31dd0ad3c74241aab64ecb4d7b55bf44, State: Initialized, Role: FOLLOWER
I20260812 16:42:11.717571 26703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33031 } }
I20260812 16:42:11.717658 26703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:11.717705 26703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:11.717758 26703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:11.718613 26703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33031 } }
I20260812 16:42:11.718735 26703 leader_election.cc:302] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31dd0ad3c74241aab64ecb4d7b55bf44; no voters:
I20260812 16:42:11.718961 26703 leader_election.cc:288] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:11.718993 26708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:11.719100 26708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [term 1 LEADER]: Becoming Leader. State: Replica: 31dd0ad3c74241aab64ecb4d7b55bf44, State: Running, Role: LEADER
I20260812 16:42:11.719185 26708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33031 } }
I20260812 16:42:11.719237 26703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:11.719524 26715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31dd0ad3c74241aab64ecb4d7b55bf44. Latest consensus state: current_term: 1 leader_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33031 } } }
I20260812 16:42:11.719615 26715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:11.719830 26727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:11.720598 26709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31dd0ad3c74241aab64ecb4d7b55bf44" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33031 } } }
I20260812 16:42:11.720821 26709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:11.721505 26727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 16:42:11 dist-test-slave-45dx krb5kdc[26547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:11.723590 26727 catalog_manager.cc:1347] Generated new cluster ID: 56316b622ebc4f1a9ef289af06520cb4
I20260812 16:42:11.723644 26727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:11.728612 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:11.716007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52324 (local address 127.21.114.126:33031)
0812 16:42:11.716198 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:11.716208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:11.716242 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:42:11.717206 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:11.717213 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:11.717261 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:11.717404 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:11.718151 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:11.719283 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:11.720396 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:11.721059 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:11.721167 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:11.724766 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:11.724770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:11.724770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:11.724782 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:11.726459 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:11.726841 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:11.726844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:11.726845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:11.727452 (+ 607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:11.727685 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:11.727686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:11.727687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:11.727931 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:11.728122 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:11.728192 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 16:42:11.728461 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260812 16:42:11.737216 26727 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:11.737941 26727 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:11.744604 26727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31dd0ad3c74241aab64ecb4d7b55bf44: Generated new TSK 0
I20260812 16:42:11.744787 26727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:11.772790 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33031
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:11.856755 26755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:11.856971 26755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:11.856994 26755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:11.858175 26755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:11.858217 26755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:11.858242 26755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:11.859616 26755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:11.859794 26755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:11.859979 26755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:11.864969 26767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:11.864976 26766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:11.864980 26769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:11.865329 26755 server_base.cc:1034] running on GCE node
I20260812 16:42:11.865564 26755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:11.865773 26755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:11.866946 26755 hybrid_clock.cc:648] HybridClock initialized: now 1786552931866936 us; error 28 us; skew 500 ppm
Aug 12 16:42:11 dist-test-slave-45dx krb5kdc[26547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552931, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:11.869587 26755 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:11.870028 26755 webserver.cc:460] Webserver started at http://127.21.114.65:34377/ using document root <none> and password file <none>
I20260812 16:42:11.870256 26755 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:11.870301 26755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:11.870440 26755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:11.871574 26755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "4a2025c0ace04befbe11e10d16d16edc"
format_stamp: "Formatted at 2026-08-12 16:42:11 on dist-test-slave-45dx"
server_key: "9eb8514b45e730a9dd133bdfe1ee69ae"
server_key_iv: "39344a00b264d7a37ab6f71cf1f2c663"
server_key_version: "encryptionkey@0"
I20260812 16:42:11.871953 26755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "4a2025c0ace04befbe11e10d16d16edc"
format_stamp: "Formatted at 2026-08-12 16:42:11 on dist-test-slave-45dx"
server_key: "9eb8514b45e730a9dd133bdfe1ee69ae"
server_key_iv: "39344a00b264d7a37ab6f71cf1f2c663"
server_key_version: "encryptionkey@0"
I20260812 16:42:11.873327 26755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:11.874050 26786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:11.874225 26755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:11.874336 26755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "4a2025c0ace04befbe11e10d16d16edc"
format_stamp: "Formatted at 2026-08-12 16:42:11 on dist-test-slave-45dx"
server_key: "9eb8514b45e730a9dd133bdfe1ee69ae"
server_key_iv: "39344a00b264d7a37ab6f71cf1f2c663"
server_key_version: "encryptionkey@0"
I20260812 16:42:11.874421 26755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:11.905215 26755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:11.907263 26755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:11.907450 26755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:11.907716 26755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:11.908052 26755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:11.908108 26755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:11.908145 26755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:11.908193 26755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:11.914127 26755 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:40533
I20260812 16:42:11.914183 26991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:40533 every 8 connection(s)
I20260812 16:42:11.914512 26755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:11.918766 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 26755
I20260812 16:42:11.918859 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:11.919049 21961 external_mini_cluster.cc:1428] Setting key b4927b616fcd1a83f73911f5cbc44384
Aug 12 16:42:11 dist-test-slave-45dx krb5kdc[26547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552931, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:11.924777 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:11.915265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:55373 (local address 127.21.114.126:33031)
0812 16:42:11.915344 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:11.915346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:11.915582 (+ 236us) server_negotiation.cc:407] Connection header received
0812 16:42:11.916070 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:11.916072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:11.916082 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:11.916137 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:11.917167 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:11.917659 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:11.918652 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:11.919005 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:11.919086 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:11.921891 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:11.921893 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:11.921893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:11.921902 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:11.923278 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:11.923716 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:11.923717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:11.923718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:11.923785 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:11.924060 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:11.924061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:11.924061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:11.924185 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:11.924263 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:11.924588 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 16:42:11.924686 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 16:42:11.925016 26995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:11.915249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33031 (local address 127.21.114.65:55373)
0812 16:42:11.915442 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:11.915482 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:11.915982 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:11.916215 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:11.916218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:11.916868 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:11.917088 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:11.917093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:11.917742 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:11.917742 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:11.918546 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:11.918549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:11.919115 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:11.919117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:11.919278 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:11.919948 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:11.919957 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:11.921778 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:11.923378 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:11.923386 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:11.923389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:11.923631 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:11.923859 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:11.923860 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:11.923860 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:11.923982 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:11.924255 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:11.924263 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:11.924442 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 16:42:11.924552 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 16:42:11.924719 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":105,"threads_started":1}
I20260812 16:42:11.925604 26993 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33031
I20260812 16:42:11.925724 26993 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:11.925917 26993 heartbeater.cc:511] Master 127.21.114.126:33031 requested a full tablet report, sending...
I20260812 16:42:11.926527 26634 ts_manager.cc:194] Registered new tserver with Master: 4a2025c0ace04befbe11e10d16d16edc (127.21.114.65:40533)
I20260812 16:42:11.927474 26634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:55373
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:11.947746 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33031
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:12.031500 27003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:12.031760 27003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:12.031801 27003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:12.033030 27003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:12.033103 27003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:12.033147 27003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:12.034623 27003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:12.034929 27003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:12.035183 27003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:12.040297 27015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:12.040333 27012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:12.040297 27013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:12.040546 27003 server_base.cc:1034] running on GCE node
I20260812 16:42:12.040827 27003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:12.041038 27003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:12.042198 27003 hybrid_clock.cc:648] HybridClock initialized: now 1786552932042181 us; error 28 us; skew 500 ppm
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[26547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552932, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:12.044806 27003 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:12.045251 27003 webserver.cc:460] Webserver started at http://127.21.114.66:46695/ using document root <none> and password file <none>
I20260812 16:42:12.045495 27003 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:12.045565 27003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:12.045720 27003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:12.046792 27003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "64bc3f2d1cd04a47961d01053a535dd0"
format_stamp: "Formatted at 2026-08-12 16:42:12 on dist-test-slave-45dx"
server_key: "9ad13ee5546587274b9e6ce4910e6a3b"
server_key_iv: "6b7f6c0c97b24806b2386919a14d7e99"
server_key_version: "encryptionkey@0"
I20260812 16:42:12.047200 27003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "64bc3f2d1cd04a47961d01053a535dd0"
format_stamp: "Formatted at 2026-08-12 16:42:12 on dist-test-slave-45dx"
server_key: "9ad13ee5546587274b9e6ce4910e6a3b"
server_key_iv: "6b7f6c0c97b24806b2386919a14d7e99"
server_key_version: "encryptionkey@0"
I20260812 16:42:12.048619 27003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:42:12.049371 27026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.049532 27003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:12.049642 27003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "64bc3f2d1cd04a47961d01053a535dd0"
format_stamp: "Formatted at 2026-08-12 16:42:12 on dist-test-slave-45dx"
server_key: "9ad13ee5546587274b9e6ce4910e6a3b"
server_key_iv: "6b7f6c0c97b24806b2386919a14d7e99"
server_key_version: "encryptionkey@0"
I20260812 16:42:12.049721 27003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:12.072558 27003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:12.074616 27003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:12.074798 27003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:12.075062 27003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:12.075389 27003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:12.075456 27003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.075503 27003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:12.075536 27003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.081775 27003 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:35137
I20260812 16:42:12.081821 27232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:35137 every 8 connection(s)
I20260812 16:42:12.082209 27003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:12.083591 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27003
I20260812 16:42:12.083706 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:12.083920 21961 external_mini_cluster.cc:1428] Setting key b0fb14cf7e4fad0d61b446cebb244011
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[26547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552932, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:12.092537 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:12.082988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51189 (local address 127.21.114.126:33031)
0812 16:42:12.083065 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:12.083067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:12.083289 (+ 222us) server_negotiation.cc:407] Connection header received
0812 16:42:12.083811 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:12.083813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:12.083828 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:12.083910 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:12.085153 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.085901 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.087000 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.087206 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.087295 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:12.089548 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:12.089550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:12.089550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:12.089558 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:12.091071 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:12.091496 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:12.091497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:12.091497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:12.091561 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:12.091822 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:12.091823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:12.091823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:12.091948 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:12.092027 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:12.092346 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 16:42:12.092446 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 16:42:12.092818 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:12.082959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33031 (local address 127.21.114.66:51189)
0812 16:42:12.083148 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:12.083193 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:12.083709 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:12.084000 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:12.084006 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:12.084835 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:12.085052 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:12.085057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.086005 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.086006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:12.086910 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:12.086913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.087308 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.087309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:12.087444 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:12.087998 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:12.088007 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:12.089441 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:12.091159 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:12.091167 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:12.091169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:12.091405 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:12.091631 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:12.091632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:12.091632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:12.091743 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:12.092017 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:12.092024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:12.092171 (+ 147us) client_negotiation.cc:769] Sending connection context
0812 16:42:12.092292 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 16:42:12.092475 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
I20260812 16:42:12.093477 27233 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33031
I20260812 16:42:12.093575 27233 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:12.093720 27233 heartbeater.cc:511] Master 127.21.114.126:33031 requested a full tablet report, sending...
I20260812 16:42:12.094146 26634 ts_manager.cc:194] Registered new tserver with Master: 64bc3f2d1cd04a47961d01053a535dd0 (127.21.114.66:35137)
I20260812 16:42:12.094576 26634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:51189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:12.111687 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33031
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:12.196658 27241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:12.196928 27241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:12.196954 27241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:12.198113 27241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:12.198148 27241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:12.198172 27241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:12.199568 27241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:12.199755 27241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:12.199935 27241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:12.204921 27251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:12.204921 27249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:12.204934 27248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:12.205163 27241 server_base.cc:1034] running on GCE node
I20260812 16:42:12.205530 27241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:12.205734 27241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:12.206887 27241 hybrid_clock.cc:648] HybridClock initialized: now 1786552932206875 us; error 30 us; skew 500 ppm
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[26547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552932, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:12.209618 27241 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:12.210107 27241 webserver.cc:460] Webserver started at http://127.21.114.67:42471/ using document root <none> and password file <none>
I20260812 16:42:12.210352 27241 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:12.210399 27241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:12.210604 27241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:12.211673 27241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "7104b774a0c3474b8d697690ebc2d7d4"
format_stamp: "Formatted at 2026-08-12 16:42:12 on dist-test-slave-45dx"
server_key: "5241d26d60ec9b518ec3e4f62e392b9d"
server_key_iv: "a192aa2ae7f4b8c01783aba22f83a02f"
server_key_version: "encryptionkey@0"
I20260812 16:42:12.212049 27241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "7104b774a0c3474b8d697690ebc2d7d4"
format_stamp: "Formatted at 2026-08-12 16:42:12 on dist-test-slave-45dx"
server_key: "5241d26d60ec9b518ec3e4f62e392b9d"
server_key_iv: "a192aa2ae7f4b8c01783aba22f83a02f"
server_key_version: "encryptionkey@0"
I20260812 16:42:12.213518 27241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:12.214290 27267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.214483 27241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.214588 27241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "7104b774a0c3474b8d697690ebc2d7d4"
format_stamp: "Formatted at 2026-08-12 16:42:12 on dist-test-slave-45dx"
server_key: "5241d26d60ec9b518ec3e4f62e392b9d"
server_key_iv: "a192aa2ae7f4b8c01783aba22f83a02f"
server_key_version: "encryptionkey@0"
I20260812 16:42:12.214677 27241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:12.249462 27241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:12.252104 27241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:12.252278 27241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:12.252631 27241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:12.252954 27241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:12.253011 27241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.253055 27241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:12.253083 27241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:12.258963 27241 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:39237
I20260812 16:42:12.259011 27475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:39237 every 8 connection(s)
I20260812 16:42:12.259339 27241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[26547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552932, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:12.267897 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27241
I20260812 16:42:12.267982 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:12.268131 21961 external_mini_cluster.cc:1428] Setting key 786bf8474ac6b17ba4e9cedc041301b7
I20260812 16:42:12.271065 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:12.260066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:33859 (local address 127.21.114.126:33031)
0812 16:42:12.260151 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:12.260153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:12.260383 (+ 230us) server_negotiation.cc:407] Connection header received
0812 16:42:12.260896 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:12.260897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:12.260908 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:12.260982 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:12.262421 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.263334 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.265016 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.265370 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.265436 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:12.268371 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:12.268373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:12.268373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:12.268382 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:12.269905 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:12.270277 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:12.270277 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:12.270278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:12.270330 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:12.270514 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:12.270516 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:12.270517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:12.270633 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:12.270684 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:12.270936 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 16:42:12.271003 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 16:42:12.271296 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:12.260038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33031 (local address 127.21.114.67:33859)
0812 16:42:12.260227 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:12.260266 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:12.260812 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:12.261087 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:12.261092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:12.261978 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:12.262284 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:12.262291 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.263463 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.263464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:12.264903 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:12.264906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:12.265502 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:12.265507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:12.265654 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:12.266296 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:12.266308 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:12.268177 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:12.269975 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:12.269980 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:12.269982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:12.270209 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:12.270373 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:12.270374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:12.270374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:12.270463 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:12.270689 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:12.270694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:12.270809 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 16:42:12.270890 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 16:42:12.271077 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":113,"threads_started":1}
I20260812 16:42:12.271790 27476 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33031
I20260812 16:42:12.271888 27476 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:12.272025 27476 heartbeater.cc:511] Master 127.21.114.126:33031 requested a full tablet report, sending...
I20260812 16:42:12.272382 26634 ts_manager.cc:194] Registered new tserver with Master: 7104b774a0c3474b8d697690ebc2d7d4 (127.21.114.67:39237)
I20260812 16:42:12.272768 26634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:33859
I20260812 16:42:12.279655 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 16:42:12.291910 26707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:12.291078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40990 (local address 127.21.114.126:33031)
0812 16:42:12.291141 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:12.291143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:12.291237 (+ 94us) server_negotiation.cc:407] Connection header received
0812 16:42:12.291279 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:12.291279 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:12.291289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:12.291348 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:12.291855 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40990: BlockingRecv error: recv got EOF from 127.0.0.1:40990 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 16:42:12.292996 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 26755
I20260812 16:42:12.308867 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27003
I20260812 16:42:12.326332 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27241
I20260812 16:42:12.337189 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 26569
2026-08-12T16:42:12Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2208 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[27497](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[27497](info): set up 2 sockets
Aug 12 16:42:12 dist-test-slave-45dx krb5kdc[27497](info): commencing operation
krb5kdc: starting...
W20260812 16:42:13.644258 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:13 dist-test-slave-45dx krb5kdc[27497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:13.767447 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35811
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:13.851557 27520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:13.851763 27520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:13.851784 27520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:13.852988 27520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:13.853030 27520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:13.853044 27520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:13.853057 27520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:13.853070 27520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:13.854691 27520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:13.854897 27520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:13.855088 27520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:13.860173 27520 server_base.cc:1034] running on GCE node
W20260812 16:42:13.860072 27529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:13.860127 27530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:13.860077 27532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:13.860769 27520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:13.861065 27520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:13.862233 27520 hybrid_clock.cc:648] HybridClock initialized: now 1786552933862216 us; error 45 us; skew 500 ppm
Aug 12 16:42:13 dist-test-slave-45dx krb5kdc[27497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552933, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:13.864825 27520 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:13.865223 27520 webserver.cc:460] Webserver started at http://127.21.114.126:39129/ using document root <none> and password file <none>
I20260812 16:42:13.865435 27520 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:13.865476 27520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:13.865566 27520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:13.866885 27520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8"
format_stamp: "Formatted at 2026-08-12 16:42:13 on dist-test-slave-45dx"
server_key: "b35b0763d7cf629cdcd62d41136802c9"
server_key_iv: "533f45dc3f00145d440a77d751c9864a"
server_key_version: "encryptionkey@0"
I20260812 16:42:13.867314 27520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8"
format_stamp: "Formatted at 2026-08-12 16:42:13 on dist-test-slave-45dx"
server_key: "b35b0763d7cf629cdcd62d41136802c9"
server_key_iv: "533f45dc3f00145d440a77d751c9864a"
server_key_version: "encryptionkey@0"
I20260812 16:42:13.868724 27520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:13.869423 27544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:13.869655 27520 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:13.869757 27520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8"
format_stamp: "Formatted at 2026-08-12 16:42:13 on dist-test-slave-45dx"
server_key: "b35b0763d7cf629cdcd62d41136802c9"
server_key_iv: "533f45dc3f00145d440a77d751c9864a"
server_key_version: "encryptionkey@0"
I20260812 16:42:13.869846 27520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:13.881667 27520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:13.883440 27520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:13.883551 27520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:13.887537 27520 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:35811
I20260812 16:42:13.887609 27656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:35811 every 8 connection(s)
I20260812 16:42:13.888082 27520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:13.888775 27657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:13.891099 27657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8: Bootstrap starting.
I20260812 16:42:13.891716 27657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:13.892032 27657 log.cc:824] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:13.892588 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27520
I20260812 16:42:13.892689 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:13.892820 27657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8: No bootstrap required, opened a new log
I20260812 16:42:13.892896 21961 external_mini_cluster.cc:1428] Setting key 99712d49fde548b6f6fc076b394228e3
I20260812 16:42:13.895809 27657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35811 } }
I20260812 16:42:13.895983 27657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:13.896016 27657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa62dfd0a7e458f8fcfc3b9f65417f8, State: Initialized, Role: FOLLOWER
I20260812 16:42:13.896128 27657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35811 } }
I20260812 16:42:13.896200 27657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:13.896226 27657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:13.896262 27657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:13.896942 27657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35811 } }
I20260812 16:42:13.897034 27657 leader_election.cc:302] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa62dfd0a7e458f8fcfc3b9f65417f8; no voters:
I20260812 16:42:13.897229 27657 leader_election.cc:288] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:13.897302 27666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:13.897440 27666 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [term 1 LEADER]: Becoming Leader. State: Replica: 0fa62dfd0a7e458f8fcfc3b9f65417f8, State: Running, Role: LEADER
I20260812 16:42:13.897531 27657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:13.897531 27666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35811 } }
I20260812 16:42:13.897936 27667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35811 } } }
I20260812 16:42:13.897948 27668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa62dfd0a7e458f8fcfc3b9f65417f8. Latest consensus state: current_term: 1 leader_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa62dfd0a7e458f8fcfc3b9f65417f8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35811 } } }
I20260812 16:42:13.898137 27668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:13.898483 27678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:13.898511 27667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:13.899354 27678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 16:42:13 dist-test-slave-45dx krb5kdc[27497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:13.901609 27678 catalog_manager.cc:1347] Generated new cluster ID: c091d6f3e86a4373ba7101efde4fc69b
I20260812 16:42:13.901664 27678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:13.905200 27665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:13.893386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41338 (local address 127.21.114.126:35811)
0812 16:42:13.893598 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:13.893610 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:13.893648 (+ 38us) server_negotiation.cc:407] Connection header received
0812 16:42:13.894361 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:13.894371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:13.894436 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:13.894589 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:13.895196 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:13.896610 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:13.897670 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:13.898342 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:13.898430 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:13.901830 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:13.901834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:13.901834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:13.901846 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:13.903584 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:13.903981 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:13.903984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:13.903984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:13.904092 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:13.904345 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:13.904346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:13.904346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:13.904584 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:13.904779 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:13.904874 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 16:42:13.905020 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260812 16:42:13.906239 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:42:13.922793 27678 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:13.923532 27678 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:13.925529 27665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:13.921651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41342 (local address 127.21.114.126:35811)
0812 16:42:13.921696 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:13.921698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:13.921853 (+ 155us) server_negotiation.cc:407] Connection header received
0812 16:42:13.921930 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:13.921931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:13.921942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:13.922018 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:13.922471 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:13.923138 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:13.923984 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:13.924197 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:13.924271 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:13.925048 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:13.925050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:13.925050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:13.925231 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:13.925248 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:13.925255 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:13.925318 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:13.925399 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 16:42:13.925443 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:13.930297 27678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fa62dfd0a7e458f8fcfc3b9f65417f8: Generated new TSK 0
I20260812 16:42:13.930480 27678 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:13.934130 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27520
2026-08-12T16:42:13Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1614 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:14 dist-test-slave-45dx krb5kdc[27710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:14 dist-test-slave-45dx krb5kdc[27710](info): set up 2 sockets
Aug 12 16:42:14 dist-test-slave-45dx krb5kdc[27710](info): commencing operation
krb5kdc: starting...
W20260812 16:42:15.273713 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:15.398599 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36903
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:36903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:15.483525 27735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:15.483727 27735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:15.483753 27735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:15.484964 27735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:15.485008 27735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:15.485023 27735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:15.485035 27735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:15.485085 27735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:15.486526 27735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:36903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:15.486776 27735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:15.487015 27735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:15.492082 27747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:15.492103 27748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:15.492208 27735 server_base.cc:1034] running on GCE node
W20260812 16:42:15.492085 27750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:15.492610 27735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:15.492976 27735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:15.494130 27735 hybrid_clock.cc:648] HybridClock initialized: now 1786552935494112 us; error 42 us; skew 500 ppm
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:15.501819 27735 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:15.502228 27735 webserver.cc:460] Webserver started at http://127.21.114.126:37701/ using document root <none> and password file <none>
I20260812 16:42:15.502446 27735 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:15.502487 27735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:15.502578 27735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:15.503628 27735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "9b080bd18ffc4c4289b1135b6f36197d"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "585a78495097cedbeebfbff1398d8643"
server_key_iv: "bba8cf7256845d90d2dc7fc2ef10e9a0"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.503942 27735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "9b080bd18ffc4c4289b1135b6f36197d"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "585a78495097cedbeebfbff1398d8643"
server_key_iv: "bba8cf7256845d90d2dc7fc2ef10e9a0"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.505378 27735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:15.506102 27766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.506309 27735 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:15.506428 27735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "9b080bd18ffc4c4289b1135b6f36197d"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "585a78495097cedbeebfbff1398d8643"
server_key_iv: "bba8cf7256845d90d2dc7fc2ef10e9a0"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.506506 27735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:15.515023 27735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:15.517416 27735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:15.517585 27735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:15.521705 27735 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:36903
I20260812 16:42:15.521763 27851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:36903 every 8 connection(s)
I20260812 16:42:15.522123 27735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:15.523164 27854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:15.523451 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27735
I20260812 16:42:15.523555 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:15.523753 21961 external_mini_cluster.cc:1428] Setting key 727052637abde4f1c49595db13a7ac69
I20260812 16:42:15.525856 27854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d: Bootstrap starting.
I20260812 16:42:15.526482 27854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:15.526782 27854 log.cc:824] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:15.527470 27854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d: No bootstrap required, opened a new log
I20260812 16:42:15.529493 27854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b080bd18ffc4c4289b1135b6f36197d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36903 } }
I20260812 16:42:15.529664 27854 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:15.529704 27854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b080bd18ffc4c4289b1135b6f36197d, State: Initialized, Role: FOLLOWER
I20260812 16:42:15.529840 27854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b080bd18ffc4c4289b1135b6f36197d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36903 } }
I20260812 16:42:15.529939 27854 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:15.529971 27854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:15.530025 27854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 0 FOLLOWER]: Advancing to term 1
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:15.530779 27854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b080bd18ffc4c4289b1135b6f36197d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36903 } }
I20260812 16:42:15.530907 27854 leader_election.cc:302] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b080bd18ffc4c4289b1135b6f36197d; no voters:
I20260812 16:42:15.531083 27854 leader_election.cc:288] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:15.531150 27866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:15.531313 27866 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [term 1 LEADER]: Becoming Leader. State: Replica: 9b080bd18ffc4c4289b1135b6f36197d, State: Running, Role: LEADER
I20260812 16:42:15.531365 27854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:15.531415 27866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b080bd18ffc4c4289b1135b6f36197d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36903 } }
I20260812 16:42:15.531780 27867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b080bd18ffc4c4289b1135b6f36197d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b080bd18ffc4c4289b1135b6f36197d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36903 } } }
I20260812 16:42:15.531795 27866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b080bd18ffc4c4289b1135b6f36197d. Latest consensus state: current_term: 1 leader_uuid: "9b080bd18ffc4c4289b1135b6f36197d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b080bd18ffc4c4289b1135b6f36197d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36903 } } }
I20260812 16:42:15.532253 27867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:15.532264 27866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d [sys.catalog]: This master's current role is: LEADER
W20260812 16:42:15.533360 27892 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:15.533465 27892 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:15.533573 27882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:15.533753 27882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:15.535238 27864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:15.524344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60956 (local address 127.21.114.126:36903)
0812 16:42:15.524535 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:15.524545 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:15.524580 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:42:15.524986 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:15.524992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:15.525037 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:15.525197 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:15.525842 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.526893 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.527730 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.528143 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.528282 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:15.530958 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:15.530962 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:15.530963 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:15.530977 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:15.533500 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:15.533926 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:15.533928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:15.533929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:15.534046 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:15.534285 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:15.534286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:15.534286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:15.534594 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:15.534770 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:15.534894 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 16:42:15.535039 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
I20260812 16:42:15.536700 27882 catalog_manager.cc:1347] Generated new cluster ID: 8116a772f4e042e88f5fdcd12d9b9355
I20260812 16:42:15.536761 27882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:15.544039 27882 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:15.544790 27882 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:15.549809 27882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b080bd18ffc4c4289b1135b6f36197d: Generated new TSK 0
I20260812 16:42:15.550004 27882 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:15.581568 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36903
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:15.687052 27902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:15.687297 27902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:15.687323 27902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:15.688570 27902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:15.688616 27902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:15.688642 27902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:15.690101 27902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:15.690348 27902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:15.690605 27902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:15.696707 27920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:15.696715 27917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:15.696939 27902 server_base.cc:1034] running on GCE node
W20260812 16:42:15.696715 27916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:15.697214 27902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:15.697486 27902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:15.698678 27902 hybrid_clock.cc:648] HybridClock initialized: now 1786552935698666 us; error 31 us; skew 500 ppm
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:15.701350 27902 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:15.701807 27902 webserver.cc:460] Webserver started at http://127.21.114.65:40613/ using document root <none> and password file <none>
I20260812 16:42:15.702039 27902 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:15.702085 27902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:15.702236 27902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:15.703334 27902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "ca9faef110e94d828c114f4e34ea5d47"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "e4d3ea90528b3fa5a1e139d5c3f430a4"
server_key_iv: "a560fe2a1849b178fb141a4cdddc3614"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.703740 27902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "ca9faef110e94d828c114f4e34ea5d47"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "e4d3ea90528b3fa5a1e139d5c3f430a4"
server_key_iv: "a560fe2a1849b178fb141a4cdddc3614"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.705202 27902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:15.705931 27933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.706103 27902 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:15.706192 27902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "ca9faef110e94d828c114f4e34ea5d47"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "e4d3ea90528b3fa5a1e139d5c3f430a4"
server_key_iv: "a560fe2a1849b178fb141a4cdddc3614"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.706246 27902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:15.716714 27902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:15.718657 27902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:15.718770 27902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:15.718964 27902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:15.719214 27902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:15.719244 27902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.719267 27902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:15.719280 27902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.725180 27902 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:42183
I20260812 16:42:15.725258 28155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:42183 every 8 connection(s)
I20260812 16:42:15.725579 27902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:15.727829 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27902
I20260812 16:42:15.727926 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:15.728152 21961 external_mini_cluster.cc:1428] Setting key cef9c0ba78a1158f8bcb13ffe9de1a8e
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:15.736202 27864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:15.726334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:48839 (local address 127.21.114.126:36903)
0812 16:42:15.726388 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:15.726390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:15.726591 (+ 201us) server_negotiation.cc:407] Connection header received
0812 16:42:15.727082 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:15.727083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:15.727092 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:15.727150 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:15.728157 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.728831 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.729838 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.730176 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.730252 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:15.732902 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:15.732904 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:15.732905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:15.732919 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:15.734720 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:15.735142 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:15.735144 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:15.735144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:15.735217 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:15.735467 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:15.735468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:15.735469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:15.735631 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:15.735712 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:15.735990 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 16:42:15.736084 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:42:15.736210 28162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:15.726289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36903 (local address 127.21.114.65:48839)
0812 16:42:15.726464 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:15.726506 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:15.727001 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:15.727202 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:15.727206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:15.727772 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:15.728055 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:15.728062 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.728949 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.728950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:15.729745 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:15.729747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.730265 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.730266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:15.730445 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:15.730989 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:15.731001 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:15.732793 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:15.734817 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:15.734830 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:15.734832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:15.735060 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:15.735292 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:15.735292 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:15.735292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:15.735394 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:15.735704 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:15.735709 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:15.735825 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 16:42:15.735927 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 16:42:15.736046 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260812 16:42:15.736734 28157 heartbeater.cc:347] Connected to a master server at 127.21.114.126:36903
I20260812 16:42:15.736852 28157 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:15.737056 28157 heartbeater.cc:511] Master 127.21.114.126:36903 requested a full tablet report, sending...
I20260812 16:42:15.737744 27794 ts_manager.cc:194] Registered new tserver with Master: ca9faef110e94d828c114f4e34ea5d47 (127.21.114.65:42183)
I20260812 16:42:15.738370 27794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:48839
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:15.759284 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36903
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:15.842221 28166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:15.842437 28166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:15.842461 28166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:15.843653 28166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:15.843696 28166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:15.843721 28166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:15.845260 28166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:15.845520 28166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:15.845786 28166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:15.850914 28185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:15.851050 28180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:15.850914 28175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:15.851065 28166 server_base.cc:1034] running on GCE node
I20260812 16:42:15.851426 28166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:15.851625 28166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:15.852820 28166 hybrid_clock.cc:648] HybridClock initialized: now 1786552935852801 us; error 31 us; skew 500 ppm
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:15.855355 28166 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:15.855846 28166 webserver.cc:460] Webserver started at http://127.21.114.66:39815/ using document root <none> and password file <none>
I20260812 16:42:15.856076 28166 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:15.856170 28166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:15.856359 28166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:15.857396 28166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "ba6d97eb44fd41239dc26a351bd6e78f"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "e12266847ed2580e8b2b6ffe9d060295"
server_key_iv: "c1b498fee189b66903415da3d21780b1"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.857719 28166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "ba6d97eb44fd41239dc26a351bd6e78f"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "e12266847ed2580e8b2b6ffe9d060295"
server_key_iv: "c1b498fee189b66903415da3d21780b1"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.859058 28166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:42:15.859810 28196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.860021 28166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:15.860129 28166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "ba6d97eb44fd41239dc26a351bd6e78f"
format_stamp: "Formatted at 2026-08-12 16:42:15 on dist-test-slave-45dx"
server_key: "e12266847ed2580e8b2b6ffe9d060295"
server_key_iv: "c1b498fee189b66903415da3d21780b1"
server_key_version: "encryptionkey@0"
I20260812 16:42:15.860215 28166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:15.870144 28166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:15.872017 28166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:15.872185 28166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:15.872505 28166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:15.872824 28166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:15.872882 28166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.872922 28166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:15.872965 28166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:15.879014 28166 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:34287
I20260812 16:42:15.879055 28397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:34287 every 8 connection(s)
I20260812 16:42:15.879380 28166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:15.884629 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28166
I20260812 16:42:15.884750 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:15.884974 21961 external_mini_cluster.cc:1428] Setting key cb084cae54f87224a10145d4b72c28bf
Aug 12 16:42:15 dist-test-slave-45dx krb5kdc[27710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552935, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:15.889245 27864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:15.880119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:53495 (local address 127.21.114.126:36903)
0812 16:42:15.880187 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:15.880189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:15.880403 (+ 214us) server_negotiation.cc:407] Connection header received
0812 16:42:15.880914 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:15.880915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:15.880924 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:15.880978 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:15.881901 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.882391 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.883356 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.883541 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.883593 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:15.885910 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:15.885912 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:15.885912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:15.885920 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:15.887565 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:15.888189 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:15.888190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:15.888190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:15.888246 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:15.888573 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:15.888574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:15.888574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:15.888698 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:15.888755 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:15.889116 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 16:42:15.889183 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 16:42:15.889523 28403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:15.880077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36903 (local address 127.21.114.66:53495)
0812 16:42:15.880263 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:15.880321 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:15.880829 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:15.881040 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:15.881043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:15.881617 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:15.881824 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:15.881830 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.882471 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.882472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:15.883270 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:15.883272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:15.883616 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:15.883617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:15.883719 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:15.884185 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:15.884194 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:15.885822 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:15.887761 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:15.887769 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:15.887772 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:15.888107 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:15.888341 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:15.888341 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:15.888342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:15.888494 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:15.888771 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:15.888777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:15.888963 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 16:42:15.889079 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 16:42:15.889263 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
I20260812 16:42:15.890028 28400 heartbeater.cc:347] Connected to a master server at 127.21.114.126:36903
I20260812 16:42:15.890126 28400 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:15.890314 28400 heartbeater.cc:511] Master 127.21.114.126:36903 requested a full tablet report, sending...
I20260812 16:42:15.890727 27794 ts_manager.cc:194] Registered new tserver with Master: ba6d97eb44fd41239dc26a351bd6e78f (127.21.114.66:34287)
I20260812 16:42:15.891274 27794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:53495
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:15.913201 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36903
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:15.995781 28406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:15.995985 28406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:15.996007 28406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:15.997311 28406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:15.997359 28406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:15.997385 28406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:15.998857 28406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:15.999104 28406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:15.999346 28406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:16.004539 28414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:16.004546 28419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:16.004623 28413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:16.004801 28406 server_base.cc:1034] running on GCE node
I20260812 16:42:16.004981 28406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:16.005177 28406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:16.006317 28406 hybrid_clock.cc:648] HybridClock initialized: now 1786552936006303 us; error 27 us; skew 500 ppm
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[27710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552936, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:16.008955 28406 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:16.009522 28406 webserver.cc:460] Webserver started at http://127.21.114.67:33275/ using document root <none> and password file <none>
I20260812 16:42:16.009752 28406 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:16.009822 28406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:16.009964 28406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:16.011034 28406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "91aadfa88f4d44559d5326d30470b6ae"
format_stamp: "Formatted at 2026-08-12 16:42:16 on dist-test-slave-45dx"
server_key: "4d07f853d9cec326b7c537766299de8b"
server_key_iv: "4e662932636537797f7a5986deb8735a"
server_key_version: "encryptionkey@0"
I20260812 16:42:16.011422 28406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "91aadfa88f4d44559d5326d30470b6ae"
format_stamp: "Formatted at 2026-08-12 16:42:16 on dist-test-slave-45dx"
server_key: "4d07f853d9cec326b7c537766299de8b"
server_key_iv: "4e662932636537797f7a5986deb8735a"
server_key_version: "encryptionkey@0"
I20260812 16:42:16.012846 28406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:16.013567 28430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:16.013742 28406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:16.013846 28406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "91aadfa88f4d44559d5326d30470b6ae"
format_stamp: "Formatted at 2026-08-12 16:42:16 on dist-test-slave-45dx"
server_key: "4d07f853d9cec326b7c537766299de8b"
server_key_iv: "4e662932636537797f7a5986deb8735a"
server_key_version: "encryptionkey@0"
I20260812 16:42:16.013934 28406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:16.030701 28406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:16.033389 28406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:16.033561 28406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:16.033809 28406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:16.034134 28406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:16.034191 28406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:16.034235 28406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:16.034261 28406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:16.040613 28406 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:44247
I20260812 16:42:16.040659 28638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:44247 every 8 connection(s)
I20260812 16:42:16.040992 28406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[27710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552936, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:16.048472 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28406
I20260812 16:42:16.048571 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:16.048753 21961 external_mini_cluster.cc:1428] Setting key 672dd279f3e4e90c9def1d5c48b3f4a1
I20260812 16:42:16.050364 27864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:16.041709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:37779 (local address 127.21.114.126:36903)
0812 16:42:16.041762 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:16.041765 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:16.041998 (+ 233us) server_negotiation.cc:407] Connection header received
0812 16:42:16.042465 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:16.042467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:16.042476 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:16.042532 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:16.043434 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:16.043932 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:16.044982 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:16.045170 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:16.045225 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:16.047345 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:16.047347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:16.047347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:16.047354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:16.048729 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:16.049227 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:16.049229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:16.049229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:16.049299 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:16.049568 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:16.049570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:16.049570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:16.049729 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:16.049853 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:16.050167 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 16:42:16.050275 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 16:42:16.050510 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:16.041673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36903 (local address 127.21.114.67:37779)
0812 16:42:16.041854 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:16.041896 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:16.042385 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:16.042594 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:16.042597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:16.043159 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:16.043353 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:16.043358 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:16.044023 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:16.044024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:16.044895 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:16.044898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:16.045246 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:16.045247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:16.045349 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:16.045898 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:16.045907 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:16.047238 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:16.048812 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:16.048819 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:16.048822 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:16.049147 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:16.049370 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:16.049371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:16.049371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:16.049491 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:16.049845 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:16.049852 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:16.050019 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 16:42:16.050126 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 16:42:16.050285 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
I20260812 16:42:16.050972 28639 heartbeater.cc:347] Connected to a master server at 127.21.114.126:36903
I20260812 16:42:16.051074 28639 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:16.051213 28639 heartbeater.cc:511] Master 127.21.114.126:36903 requested a full tablet report, sending...
I20260812 16:42:16.051589 27794 ts_manager.cc:194] Registered new tserver with Master: 91aadfa88f4d44559d5326d30470b6ae (127.21.114.67:44247)
I20260812 16:42:16.051978 27794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:37779
I20260812 16:42:16.060580 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[27710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552936, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[27710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552936, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:16.084862 27864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:16.077536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60962 (local address 127.21.114.126:36903)
0812 16:42:16.077610 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:16.077613 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:16.077711 (+ 98us) server_negotiation.cc:407] Connection header received
0812 16:42:16.077799 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:16.077800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:16.077816 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:16.077883 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:16.078478 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:16.078977 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:16.079731 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:16.079925 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:16.080002 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:16.082352 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:16.082353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:16.082354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:16.082362 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:16.083583 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:16.083948 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:16.083950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:16.083950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:16.084010 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:16.084208 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:16.084210 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:16.084210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:16.084433 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:16.084564 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:16.084674 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 16:42:16.084754 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 16:42:16.085111 27794 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60962
I20260812 16:42:16.085530 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27902
I20260812 16:42:16.105177 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28166
I20260812 16:42:16.122032 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28406
I20260812 16:42:16.134452 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27735
2026-08-12T16:42:16Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2180 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[28657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[28657](info): set up 2 sockets
Aug 12 16:42:16 dist-test-slave-45dx krb5kdc[28657](info): commencing operation
krb5kdc: starting...
W20260812 16:42:17.487792 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:17 dist-test-slave-45dx krb5kdc[28657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:17.613509 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35339
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:17.698747 28682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:17.698971 28682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:17.698993 28682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:17.700198 28682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:17.700243 28682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:17.700258 28682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:17.700271 28682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:17.700284 28682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:17.701910 28682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:17.702199 28682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:17.702458 28682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:17.707645 28688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:17.707674 28689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:17.707784 28682 server_base.cc:1034] running on GCE node
W20260812 16:42:17.707653 28695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:17.708242 28682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:17.708592 28682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:17.709779 28682 hybrid_clock.cc:648] HybridClock initialized: now 1786552937709752 us; error 43 us; skew 500 ppm
Aug 12 16:42:17 dist-test-slave-45dx krb5kdc[28657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552937, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:17.712560 28682 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:17.712989 28682 webserver.cc:460] Webserver started at http://127.21.114.126:34141/ using document root <none> and password file <none>
I20260812 16:42:17.713186 28682 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:17.713228 28682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:17.713322 28682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:17.714422 28682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "c6f72ce50de3484b99d6ba5cf966662f"
format_stamp: "Formatted at 2026-08-12 16:42:17 on dist-test-slave-45dx"
server_key: "a013cb5bd5ff144fdf6b7e781c7f06c1"
server_key_iv: "fc4643b9d80bd94aeb6e31b18ccc88bd"
server_key_version: "encryptionkey@0"
I20260812 16:42:17.714741 28682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "c6f72ce50de3484b99d6ba5cf966662f"
format_stamp: "Formatted at 2026-08-12 16:42:17 on dist-test-slave-45dx"
server_key: "a013cb5bd5ff144fdf6b7e781c7f06c1"
server_key_iv: "fc4643b9d80bd94aeb6e31b18ccc88bd"
server_key_version: "encryptionkey@0"
I20260812 16:42:17.716092 28682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:42:17.716917 28712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:17.717128 28682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:42:17.717229 28682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "c6f72ce50de3484b99d6ba5cf966662f"
format_stamp: "Formatted at 2026-08-12 16:42:17 on dist-test-slave-45dx"
server_key: "a013cb5bd5ff144fdf6b7e781c7f06c1"
server_key_iv: "fc4643b9d80bd94aeb6e31b18ccc88bd"
server_key_version: "encryptionkey@0"
I20260812 16:42:17.717308 28682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:17.727393 28682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:17.730017 28682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:17.730222 28682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:17.735881 28682 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:35339
I20260812 16:42:17.735954 28812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:35339 every 8 connection(s)
I20260812 16:42:17.736644 28682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:17.737663 28815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:17.740622 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28682
I20260812 16:42:17.740746 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:17.740957 21961 external_mini_cluster.cc:1428] Setting key 8a39e171ffd53e65f541545236552ceb
I20260812 16:42:17.741127 28815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f: Bootstrap starting.
I20260812 16:42:17.741999 28815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:17.742443 28815 log.cc:824] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:17.743269 28815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f: No bootstrap required, opened a new log
I20260812 16:42:17.745807 28815 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f72ce50de3484b99d6ba5cf966662f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35339 } }
I20260812 16:42:17.745959 28815 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:17.745983 28815 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f72ce50de3484b99d6ba5cf966662f, State: Initialized, Role: FOLLOWER
I20260812 16:42:17.746173 28815 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f72ce50de3484b99d6ba5cf966662f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35339 } }
I20260812 16:42:17.746258 28815 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:17.746287 28815 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:17.746328 28815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:17.747098 28815 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f72ce50de3484b99d6ba5cf966662f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35339 } }
I20260812 16:42:17.747220 28815 leader_election.cc:302] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6f72ce50de3484b99d6ba5cf966662f; no voters:
I20260812 16:42:17.747412 28815 leader_election.cc:288] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:17.747452 28825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:17.747565 28825 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [term 1 LEADER]: Becoming Leader. State: Replica: c6f72ce50de3484b99d6ba5cf966662f, State: Running, Role: LEADER
I20260812 16:42:17.747699 28815 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:17.747670 28825 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f72ce50de3484b99d6ba5cf966662f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35339 } }
I20260812 16:42:17.748039 28825 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6f72ce50de3484b99d6ba5cf966662f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f72ce50de3484b99d6ba5cf966662f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35339 } } }
I20260812 16:42:17.748204 28825 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:17.748447 28825 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6f72ce50de3484b99d6ba5cf966662f. Latest consensus state: current_term: 1 leader_uuid: "c6f72ce50de3484b99d6ba5cf966662f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f72ce50de3484b99d6ba5cf966662f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35339 } } }
I20260812 16:42:17.748582 28825 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f [sys.catalog]: This master's current role is: LEADER
Aug 12 16:42:17 dist-test-slave-45dx krb5kdc[28657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
W20260812 16:42:17.749579 28857 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:17.749639 28857 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:17.749850 28840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:17.750102 28840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:17.751891 28840 catalog_manager.cc:1347] Generated new cluster ID: bea7bca0370e4f579342eecf1198c346
I20260812 16:42:17.751957 28840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:17.753777 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:17.741618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41098 (local address 127.21.114.126:35339)
0812 16:42:17.741832 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:17.741850 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:17.741883 (+ 33us) server_negotiation.cc:407] Connection header received
0812 16:42:17.742583 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:17.742595 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:17.742664 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:17.742838 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:17.743707 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:17.745163 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:17.746064 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:17.746706 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:17.746827 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:17.749763 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:17.749767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:17.749768 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:17.749781 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:17.751891 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:17.752363 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:17.752366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:17.752367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:17.752496 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:17.752742 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:17.752743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:17.752744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:17.753097 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:17.753297 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:17.753384 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 16:42:17.753543 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":104,"threads_started":1}
I20260812 16:42:17.790021 28840 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:17.790638 28840 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:17.793869 28840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6f72ce50de3484b99d6ba5cf966662f: Generated new TSK 0
I20260812 16:42:17.794090 28840 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:17.831794 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35339
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:17.917016 28873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:17.917227 28873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:17.917250 28873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:17.918427 28873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:17.918473 28873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:17.918500 28873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:17.920135 28873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:17.920415 28873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:17.920663 28873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:17.925915 28893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:17.925943 28888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:17.925915 28886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:17.926322 28873 server_base.cc:1034] running on GCE node
I20260812 16:42:17.926542 28873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:17.926740 28873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:17.927896 28873 hybrid_clock.cc:648] HybridClock initialized: now 1786552937927883 us; error 30 us; skew 500 ppm
Aug 12 16:42:17 dist-test-slave-45dx krb5kdc[28657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552937, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:17.930670 28873 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:17.931154 28873 webserver.cc:460] Webserver started at http://127.21.114.65:36415/ using document root <none> and password file <none>
I20260812 16:42:17.931346 28873 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:17.931388 28873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:17.931485 28873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:17.932590 28873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "afc763373ea74938a3f21ce5d0bfd980"
format_stamp: "Formatted at 2026-08-12 16:42:17 on dist-test-slave-45dx"
server_key: "20f0a33d10990295a8f3e1a687a1e227"
server_key_iv: "bd65d02eef01db214ea0363bb75d1a5b"
server_key_version: "encryptionkey@0"
I20260812 16:42:17.932914 28873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "afc763373ea74938a3f21ce5d0bfd980"
format_stamp: "Formatted at 2026-08-12 16:42:17 on dist-test-slave-45dx"
server_key: "20f0a33d10990295a8f3e1a687a1e227"
server_key_iv: "bd65d02eef01db214ea0363bb75d1a5b"
server_key_version: "encryptionkey@0"
I20260812 16:42:17.934230 28873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 16:42:17.934967 28904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:17.935159 28873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:42:17.935277 28873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "afc763373ea74938a3f21ce5d0bfd980"
format_stamp: "Formatted at 2026-08-12 16:42:17 on dist-test-slave-45dx"
server_key: "20f0a33d10990295a8f3e1a687a1e227"
server_key_iv: "bd65d02eef01db214ea0363bb75d1a5b"
server_key_version: "encryptionkey@0"
I20260812 16:42:17.935367 28873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:17.952183 28873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:17.954816 28873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:17.955017 28873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:17.955291 28873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:17.955639 28873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:17.955701 28873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:17.955744 28873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:17.955773 28873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:17.962030 28873 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:38285
I20260812 16:42:17.962091 29120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:38285 every 8 connection(s)
I20260812 16:42:17.962423 28873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:17.967674 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28873
I20260812 16:42:17.967799 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:17.967995 21961 external_mini_cluster.cc:1428] Setting key 0ada89173ab328bf82d9cb8cad8bc80d
Aug 12 16:42:17 dist-test-slave-45dx krb5kdc[28657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552937, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:17.972749 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:17.963219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:48521 (local address 127.21.114.126:35339)
0812 16:42:17.963292 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:17.963294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:17.963487 (+ 193us) server_negotiation.cc:407] Connection header received
0812 16:42:17.964444 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:17.964445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:17.964455 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:17.964521 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:17.965138 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:17.965645 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:17.966624 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:17.966815 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:17.966866 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:17.969464 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:17.969466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:17.969467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:17.969475 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:17.971024 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:17.971557 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:17.971558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:17.971559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:17.971617 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:17.971947 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:17.971948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:17.971948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:17.972101 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:17.972172 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:17.972504 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 16:42:17.972610 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 16:42:17.972764 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:17.963169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35339 (local address 127.21.114.65:48521)
0812 16:42:17.963344 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:17.963388 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:17.964337 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:17.964579 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:17.964583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:17.964853 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:17.965055 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:17.965060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:17.965734 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:17.965735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:17.966540 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:17.966543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:17.966907 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:17.966907 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:17.967014 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:17.967613 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:17.967622 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:17.969365 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:17.971119 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:17.971127 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:17.971130 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:17.971477 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:17.971687 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:17.971688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:17.971688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:17.971859 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:17.972172 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:17.972179 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:17.972350 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 16:42:17.972459 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 16:42:17.972594 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260812 16:42:17.973496 29121 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35339
I20260812 16:42:17.973614 29121 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:17.973841 29121 heartbeater.cc:511] Master 127.21.114.126:35339 requested a full tablet report, sending...
I20260812 16:42:17.974411 28752 ts_manager.cc:194] Registered new tserver with Master: afc763373ea74938a3f21ce5d0bfd980 (127.21.114.65:38285)
I20260812 16:42:17.975045 28752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:48521
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:17.996666 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35339
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:18.081820 29137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:18.082041 29137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:18.082063 29137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:18.083264 29137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:18.083315 29137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:18.083343 29137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:18.085004 29137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:18.085263 29137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:18.085523 29137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:18.090984 29150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:18.090987 29148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:18.091076 29147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:18.091007 29137 server_base.cc:1034] running on GCE node
I20260812 16:42:18.091492 29137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:18.091756 29137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:18.092938 29137 hybrid_clock.cc:648] HybridClock initialized: now 1786552938092938 us; error 47 us; skew 500 ppm
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:18.095604 29137 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:18.096117 29137 webserver.cc:460] Webserver started at http://127.21.114.66:41399/ using document root <none> and password file <none>
I20260812 16:42:18.096421 29137 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:18.096496 29137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:18.096658 29137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:18.097747 29137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "cc079c41d6a44335a32f64a12b97c8e2"
format_stamp: "Formatted at 2026-08-12 16:42:18 on dist-test-slave-45dx"
server_key: "c7ac1f0849247db5a9323512e93998dc"
server_key_iv: "5cead6748e857b2e2fe1c894bd2b6db8"
server_key_version: "encryptionkey@0"
I20260812 16:42:18.098142 29137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "cc079c41d6a44335a32f64a12b97c8e2"
format_stamp: "Formatted at 2026-08-12 16:42:18 on dist-test-slave-45dx"
server_key: "c7ac1f0849247db5a9323512e93998dc"
server_key_iv: "5cead6748e857b2e2fe1c894bd2b6db8"
server_key_version: "encryptionkey@0"
I20260812 16:42:18.099514 29137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:18.100251 29162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:18.100451 29137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:18.100562 29137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "cc079c41d6a44335a32f64a12b97c8e2"
format_stamp: "Formatted at 2026-08-12 16:42:18 on dist-test-slave-45dx"
server_key: "c7ac1f0849247db5a9323512e93998dc"
server_key_iv: "5cead6748e857b2e2fe1c894bd2b6db8"
server_key_version: "encryptionkey@0"
I20260812 16:42:18.100641 29137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:18.108645 29137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:18.110430 29137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:18.110596 29137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:18.110822 29137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:18.111150 29137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:18.111210 29137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:18.111243 29137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:18.111271 29137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:18.117312 29137 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:41587
I20260812 16:42:18.117362 29387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:41587 every 8 connection(s)
I20260812 16:42:18.117681 29137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:18.121788 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29137
I20260812 16:42:18.121874 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:18.122061 21961 external_mini_cluster.cc:1428] Setting key ed863522630e579f83181f38c313b2f6
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:18.127928 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:18.118416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:37409 (local address 127.21.114.126:35339)
0812 16:42:18.118489 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:18.118491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:18.118699 (+ 208us) server_negotiation.cc:407] Connection header received
0812 16:42:18.119674 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:18.119675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:18.119692 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:18.119746 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:18.120401 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.120960 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.122098 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.122385 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.122460 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:18.125001 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:18.125003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:18.125004 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:18.125011 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:18.126469 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.126935 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.126936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.126936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.126999 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.127266 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.127267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.127267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.127385 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:18.127459 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:18.127747 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 16:42:18.127829 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:18.128159 29391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:18.118389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35339 (local address 127.21.114.66:37409)
0812 16:42:18.118581 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:18.118617 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:18.119544 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:18.119802 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:18.119806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:18.120064 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:18.120250 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:18.120254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.121071 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.121072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:18.122006 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:18.122009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.122485 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.122486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:18.122633 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:18.123225 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:18.123233 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:18.124896 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:18.126575 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:18.126584 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:18.126586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:18.126868 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:18.127072 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:18.127073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:18.127073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:18.127186 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:18.127462 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:18.127470 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:18.127610 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 16:42:18.127721 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 16:42:18.127877 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":109,"threads_started":1}
I20260812 16:42:18.128703 29388 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35339
I20260812 16:42:18.128798 29388 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:18.128993 29388 heartbeater.cc:511] Master 127.21.114.126:35339 requested a full tablet report, sending...
I20260812 16:42:18.129381 28752 ts_manager.cc:194] Registered new tserver with Master: cc079c41d6a44335a32f64a12b97c8e2 (127.21.114.66:41587)
I20260812 16:42:18.129760 28752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:37409
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:18.151171 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35339
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:18.235615 29397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:18.235838 29397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:18.235863 29397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:18.237188 29397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:18.237237 29397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:18.237264 29397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:18.238802 29397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:18.239054 29397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:18.239300 29397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:18.244554 29404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:18.244670 29397 server_base.cc:1034] running on GCE node
W20260812 16:42:18.244554 29405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:18.244577 29407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:18.245069 29397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:18.245285 29397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:18.246469 29397 hybrid_clock.cc:648] HybridClock initialized: now 1786552938246454 us; error 30 us; skew 500 ppm
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:18.249542 29397 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:18.250017 29397 webserver.cc:460] Webserver started at http://127.21.114.67:38421/ using document root <none> and password file <none>
I20260812 16:42:18.250254 29397 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:18.250303 29397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:18.250443 29397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:18.251540 29397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "34edb9338ce14a8aaa6f4923407e0786"
format_stamp: "Formatted at 2026-08-12 16:42:18 on dist-test-slave-45dx"
server_key: "2e954b1aa06ec5922de14fa0c704fd62"
server_key_iv: "dabe21c036b7580d130d746400b0b077"
server_key_version: "encryptionkey@0"
I20260812 16:42:18.251921 29397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "34edb9338ce14a8aaa6f4923407e0786"
format_stamp: "Formatted at 2026-08-12 16:42:18 on dist-test-slave-45dx"
server_key: "2e954b1aa06ec5922de14fa0c704fd62"
server_key_iv: "dabe21c036b7580d130d746400b0b077"
server_key_version: "encryptionkey@0"
I20260812 16:42:18.253433 29397 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:18.254248 29420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:18.254477 29397 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:18.254575 29397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "34edb9338ce14a8aaa6f4923407e0786"
format_stamp: "Formatted at 2026-08-12 16:42:18 on dist-test-slave-45dx"
server_key: "2e954b1aa06ec5922de14fa0c704fd62"
server_key_iv: "dabe21c036b7580d130d746400b0b077"
server_key_version: "encryptionkey@0"
I20260812 16:42:18.254652 29397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:18.266706 29397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:18.269291 29397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:18.269469 29397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:18.269738 29397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:18.270084 29397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:18.270118 29397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:18.270175 29397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:18.270205 29397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:18.276007 29397 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:41053
I20260812 16:42:18.276091 29640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:41053 every 8 connection(s)
I20260812 16:42:18.276532 29397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:18.276721 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29397
I20260812 16:42:18.276829 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:18.277057 21961 external_mini_cluster.cc:1428] Setting key 04bf61308a44efb807cb658aed2ed748
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:18.286293 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:18.277389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:55443 (local address 127.21.114.126:35339)
0812 16:42:18.277492 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:18.277495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:18.277685 (+ 190us) server_negotiation.cc:407] Connection header received
0812 16:42:18.278748 (+ 1063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:18.278749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:18.278761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:18.278828 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:18.279424 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.279963 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.281043 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.281243 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.281314 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:18.283392 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:18.283393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:18.283394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:18.283401 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:18.285017 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.285394 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.285395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.285395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.285454 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.285679 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.285679 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.285680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.285800 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:18.285855 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:18.286127 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 16:42:18.286209 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 16:42:18.286372 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:18.277370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35339 (local address 127.21.114.67:55443)
0812 16:42:18.277568 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:18.277617 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:18.278652 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:18.278892 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:18.278896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:18.279150 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:18.279347 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:18.279351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.280048 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.280049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:18.280964 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:18.280968 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.281334 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.281335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:18.281437 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:18.281930 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:18.281939 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:18.283301 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:18.285092 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:18.285098 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:18.285100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:18.285321 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:18.285519 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:18.285519 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:18.285519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:18.285621 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:18.285878 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:18.285882 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:18.286000 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 16:42:18.286085 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 16:42:18.286208 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":106,"threads_started":1}
I20260812 16:42:18.286998 29641 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35339
I20260812 16:42:18.287124 29641 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:18.287314 29641 heartbeater.cc:511] Master 127.21.114.126:35339 requested a full tablet report, sending...
I20260812 16:42:18.287755 28752 ts_manager.cc:194] Registered new tserver with Master: 34edb9338ce14a8aaa6f4923407e0786 (127.21.114.67:41053)
I20260812 16:42:18.288239 28752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:55443
I20260812 16:42:18.289129 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:18.314736 29654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:18.305836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53450 (local address 127.21.114.65:38285)
0812 16:42:18.306052 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:18.306057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:18.306068 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:18.306096 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:18.306098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:18.306112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:18.306183 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:18.306902 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.307649 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.308527 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.308861 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.308919 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:18.311890 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:18.311899 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:18.311900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:18.311906 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:18.313553 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.313938 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.313941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.313941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.314015 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.314213 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.314214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.314214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.314358 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:18.314472 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:18.314558 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 16:42:18.314621 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":123,"threads_started":1}
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[28657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:18.324254 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:18.316439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41114 (local address 127.21.114.126:35339)
0812 16:42:18.316513 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:18.316515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:18.316526 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:18.316607 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:18.316608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:18.316620 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:18.316675 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:18.317258 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.317804 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.318577 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:18.318799 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:18.318899 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:18.321558 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:18.321559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:18.321560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:18.321568 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:18.323000 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.323389 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.323390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.323391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.323455 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:18.323658 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:18.323660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:18.323660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:18.323825 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:18.323943 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:18.324068 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 16:42:18.324149 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 16:42:18.324595 28752 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41114
I20260812 16:42:18.324976 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28873
I20260812 16:42:18.337371 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29137
I20260812 16:42:18.353619 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29397
I20260812 16:42:18.368789 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28682
2026-08-12T16:42:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2236 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[29667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[29667](info): set up 2 sockets
Aug 12 16:42:18 dist-test-slave-45dx krb5kdc[29667](info): commencing operation
krb5kdc: starting...
W20260812 16:42:19.692688 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:19 dist-test-slave-45dx krb5kdc[29667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:19.819041 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38331
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:38331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:19.902696 29688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:19.902925 29688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:19.902947 29688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:19.904039 29688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:19.904074 29688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:19.904088 29688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:19.904101 29688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:19.904114 29688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:19.905570 29688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:38331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:19.905777 29688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:19.905951 29688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:19.910851 29702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:19.910854 29699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:19.910858 29698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:19.911092 29688 server_base.cc:1034] running on GCE node
I20260812 16:42:19.911340 29688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:19.911639 29688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:19.912807 29688 hybrid_clock.cc:648] HybridClock initialized: now 1786552939912787 us; error 42 us; skew 500 ppm
Aug 12 16:42:19 dist-test-slave-45dx krb5kdc[29667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552939, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:19.915328 29688 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:19.915724 29688 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:19.915783 29688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:19.915957 29688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:19.917124 29688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "c3238f51bbc148ea983f47933c17bd02"
format_stamp: "Formatted at 2026-08-12 16:42:19 on dist-test-slave-45dx"
server_key: "3dc58f08e4bdcce20fdebdac3dc433a7"
server_key_iv: "e6bfd3af4f8c24a21e95bdbddcf9fdfa"
server_key_version: "encryptionkey@0"
I20260812 16:42:19.917505 29688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "c3238f51bbc148ea983f47933c17bd02"
format_stamp: "Formatted at 2026-08-12 16:42:19 on dist-test-slave-45dx"
server_key: "3dc58f08e4bdcce20fdebdac3dc433a7"
server_key_iv: "e6bfd3af4f8c24a21e95bdbddcf9fdfa"
server_key_version: "encryptionkey@0"
I20260812 16:42:19.918824 29688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:42:19.919571 29715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:19.919768 29688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:19.919869 29688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "c3238f51bbc148ea983f47933c17bd02"
format_stamp: "Formatted at 2026-08-12 16:42:19 on dist-test-slave-45dx"
server_key: "3dc58f08e4bdcce20fdebdac3dc433a7"
server_key_iv: "e6bfd3af4f8c24a21e95bdbddcf9fdfa"
server_key_version: "encryptionkey@0"
I20260812 16:42:19.919953 29688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:19.933631 29688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:19.935562 29688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:19.935748 29688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:19.940088 29688 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:38331
I20260812 16:42:19.940124 29814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:38331 every 8 connection(s)
I20260812 16:42:19.940460 29688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:19.941632 29819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:19.944176 29819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02: Bootstrap starting.
I20260812 16:42:19.944530 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29688
I20260812 16:42:19.944669 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:19.944881 21961 external_mini_cluster.cc:1428] Setting key 17efa522ce97e6c825f4978617ee198d
I20260812 16:42:19.945147 29819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:19.945549 29819 log.cc:824] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:19.946444 29819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02: No bootstrap required, opened a new log
I20260812 16:42:19.948849 29819 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3238f51bbc148ea983f47933c17bd02" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38331 } }
I20260812 16:42:19.949035 29819 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:19.949080 29819 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3238f51bbc148ea983f47933c17bd02, State: Initialized, Role: FOLLOWER
I20260812 16:42:19.949213 29819 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3238f51bbc148ea983f47933c17bd02" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38331 } }
I20260812 16:42:19.949292 29819 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:19.949316 29819 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:19.949389 29819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:19.950016 29819 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3238f51bbc148ea983f47933c17bd02" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38331 } }
I20260812 16:42:19.950125 29819 leader_election.cc:302] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3238f51bbc148ea983f47933c17bd02; no voters:
I20260812 16:42:19.950294 29819 leader_election.cc:288] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:19.950385 29829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:19.950541 29819 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:19.950560 29829 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [term 1 LEADER]: Becoming Leader. State: Replica: c3238f51bbc148ea983f47933c17bd02, State: Running, Role: LEADER
I20260812 16:42:19.950664 29829 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3238f51bbc148ea983f47933c17bd02" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38331 } }
I20260812 16:42:19.951067 29829 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3238f51bbc148ea983f47933c17bd02. Latest consensus state: current_term: 1 leader_uuid: "c3238f51bbc148ea983f47933c17bd02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3238f51bbc148ea983f47933c17bd02" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38331 } } }
I20260812 16:42:19.951223 29829 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:19.951433 29836 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3238f51bbc148ea983f47933c17bd02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3238f51bbc148ea983f47933c17bd02" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38331 } } }
I20260812 16:42:19.951531 29849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:19.951593 29836 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:19.952236 29849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 16:42:19 dist-test-slave-45dx krb5kdc[29667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:19.954156 29849 catalog_manager.cc:1347] Generated new cluster ID: c076d11f96674f03a636120f18ccfebc
I20260812 16:42:19.954217 29849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:19.958091 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:19.945504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.21.114.126:38331)
0812 16:42:19.945705 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:19.945715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:19.945754 (+ 39us) server_negotiation.cc:407] Connection header received
0812 16:42:19.946391 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:19.946400 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:19.946458 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:19.946640 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:19.947440 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:19.948911 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:19.949955 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:19.950627 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:19.951096 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:19.954029 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:19.954034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:19.954034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:19.954049 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:19.956207 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:19.956683 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:19.956687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:19.956687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:19.956816 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:19.957048 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:19.957049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:19.957050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:19.957406 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:19.957585 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:19.957710 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 16:42:19.957864 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":114,"threads_started":1}
I20260812 16:42:19.988880 29849 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:19.989691 29849 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:19.993505 29849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02: Generated new TSK 0
I20260812 16:42:19.993716 29849 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:20.027602 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38331
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:20.112267 29868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:20.112546 29868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:20.112587 29868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:20.113757 29868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:20.113831 29868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:20.113876 29868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:20.115376 29868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:20.115646 29868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:20.115880 29868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:20.121003 29875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.121038 29874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.121008 29878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:20.121295 29868 server_base.cc:1034] running on GCE node
I20260812 16:42:20.121515 29868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:20.121836 29868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:20.123021 29868 hybrid_clock.cc:648] HybridClock initialized: now 1786552940123009 us; error 29 us; skew 500 ppm
Aug 12 16:42:20 dist-test-slave-45dx krb5kdc[29667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552940, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:20.125687 29868 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:20.126096 29868 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:20.126175 29868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:20.126333 29868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:20.127403 29868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "2551ba7b86c248d9bddefdf4a1d2fc32"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "054df7864074c3d01928a85a6a8a6b0b"
server_key_iv: "889051d4064ee873cf925c20818d615e"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.127799 29868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "2551ba7b86c248d9bddefdf4a1d2fc32"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "054df7864074c3d01928a85a6a8a6b0b"
server_key_iv: "889051d4064ee873cf925c20818d615e"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.129262 29868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:20.130033 29889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.130218 29868 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:20.130328 29868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "2551ba7b86c248d9bddefdf4a1d2fc32"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "054df7864074c3d01928a85a6a8a6b0b"
server_key_iv: "889051d4064ee873cf925c20818d615e"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.130409 29868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:20.152956 29868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:20.155675 29868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:20.155875 29868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:20.156158 29868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:20.156592 29868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:20.156665 29868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.156704 29868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:20.156734 29868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.163236 29868 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:35471
I20260812 16:42:20.163271 30093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:35471 every 8 connection(s)
I20260812 16:42:20.163630 29868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
Aug 12 16:42:20 dist-test-slave-45dx krb5kdc[29667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552940, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:20.173120 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.164437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:48347 (local address 127.21.114.126:38331)
0812 16:42:20.164509 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.164512 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.164790 (+ 278us) server_negotiation.cc:407] Connection header received
0812 16:42:20.165240 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.165242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.165256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.165323 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:20.166249 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.166827 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.167828 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.168054 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.168119 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.170295 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:20.170297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:20.170297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:20.170304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:20.171872 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.172226 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.172227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.172227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.172282 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.172561 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.172562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.172562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.172672 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:20.172726 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.172981 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.173053 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 16:42:20.173298 30097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.164425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38331 (local address 127.21.114.65:48347)
0812 16:42:20.164616 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.164661 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.165155 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.165378 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.165381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.165629 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:20.166161 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.166167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.166916 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.166917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.167737 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.167739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.168142 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.168143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.168247 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.168783 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:20.168792 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:20.170158 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:20.171948 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:20.171953 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:20.171955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:20.172158 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:20.172398 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:20.172399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:20.172399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:20.172502 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:20.172733 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:20.172738 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:20.172867 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.172951 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.173070 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260812 16:42:20.173868 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29868
I20260812 16:42:20.173954 30094 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38331
I20260812 16:42:20.174000 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:20.174077 30094 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:20.174206 21961 external_mini_cluster.cc:1428] Setting key 2f67ddac6a5ee9fa3302827040a04121
I20260812 16:42:20.174268 30094 heartbeater.cc:511] Master 127.21.114.126:38331 requested a full tablet report, sending...
I20260812 16:42:20.174780 29745 ts_manager.cc:194] Registered new tserver with Master: 2551ba7b86c248d9bddefdf4a1d2fc32 (127.21.114.65:35471)
I20260812 16:42:20.175422 29745 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:48347
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:20.203685 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38331
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:20.295451 30101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:20.295652 30101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:20.295675 30101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:20.296850 30101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:20.296895 30101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:20.296922 30101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:20.298377 30101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:20.298553 30101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:20.298725 30101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:20.304175 30101 server_base.cc:1034] running on GCE node
W20260812 16:42:20.304109 30110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.304104 30113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.304100 30109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:20.304632 30101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:20.304929 30101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:20.306093 30101 hybrid_clock.cc:648] HybridClock initialized: now 1786552940306091 us; error 55 us; skew 500 ppm
Aug 12 16:42:20 dist-test-slave-45dx krb5kdc[29667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552940, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:20.308728 30101 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:20.309087 30101 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:20.309166 30101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:20.309324 30101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:20.310379 30101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "8a1efc9c5087468dbec18d7ecf057c7f"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "d3bd2178f029bcbf1af12cc71ec86cdb"
server_key_iv: "4e3d602ed89f22839c236c69062fbfc1"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.310755 30101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "8a1efc9c5087468dbec18d7ecf057c7f"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "d3bd2178f029bcbf1af12cc71ec86cdb"
server_key_iv: "4e3d602ed89f22839c236c69062fbfc1"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.312062 30101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:20.312825 30121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.313020 30101 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.313125 30101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "8a1efc9c5087468dbec18d7ecf057c7f"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "d3bd2178f029bcbf1af12cc71ec86cdb"
server_key_iv: "4e3d602ed89f22839c236c69062fbfc1"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.313215 30101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:20.322279 30101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:20.324714 30101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:20.324878 30101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:20.325110 30101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:20.325439 30101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:20.325497 30101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.325539 30101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:20.325567 30101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.331408 30101 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:36011
I20260812 16:42:20.331475 30331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:36011 every 8 connection(s)
I20260812 16:42:20.331770 30101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:42:20 dist-test-slave-45dx krb5kdc[29667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552940, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:20.339623 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30101
I20260812 16:42:20.339741 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:20.339958 21961 external_mini_cluster.cc:1428] Setting key f9970b52da03969530db06ed34e246f1
I20260812 16:42:20.341853 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.332544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:57107 (local address 127.21.114.126:38331)
0812 16:42:20.332613 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.332616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.332837 (+ 221us) server_negotiation.cc:407] Connection header received
0812 16:42:20.333310 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.333311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.333322 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.333381 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:20.334331 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.334943 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.335953 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.336177 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.336248 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.338491 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:20.338493 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:20.338493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:20.338500 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:20.340333 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.340822 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.340824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.340824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.340893 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.341158 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.341159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.341159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.341284 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:20.341365 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.341652 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.341764 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:42:20.342046 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.332525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38331 (local address 127.21.114.66:57107)
0812 16:42:20.332704 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.332742 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.333215 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.333450 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.333453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.333715 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:20.334239 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.334244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.335021 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.335022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.335839 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.335841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.336263 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.336264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.336450 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.336942 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:20.336950 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:20.338396 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:20.340414 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:20.340422 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:20.340424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:20.340716 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:20.340952 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:20.340954 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:20.340954 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:20.341070 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:20.341357 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:20.341364 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:20.341507 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.341617 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.341797 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260812 16:42:20.342954 30332 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38331
I20260812 16:42:20.343046 30332 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:20.343228 30332 heartbeater.cc:511] Master 127.21.114.126:38331 requested a full tablet report, sending...
I20260812 16:42:20.343665 29745 ts_manager.cc:194] Registered new tserver with Master: 8a1efc9c5087468dbec18d7ecf057c7f (127.21.114.66:36011)
I20260812 16:42:20.344102 29745 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:57107
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:20.367501 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38331
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:20.450832 30343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:20.451031 30343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:20.451054 30343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:20.452448 30343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:20.452491 30343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:20.452518 30343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:20.454041 30343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:20.454291 30343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:20.454538 30343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:20.459609 30357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.459627 30352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.459615 30351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:20.459827 30343 server_base.cc:1034] running on GCE node
I20260812 16:42:20.460044 30343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:20.460253 30343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:20.461391 30343 hybrid_clock.cc:648] HybridClock initialized: now 1786552940461370 us; error 39 us; skew 500 ppm
Aug 12 16:42:20 dist-test-slave-45dx krb5kdc[29667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552940, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:20.463976 30343 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:20.464426 30343 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:20.464479 30343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:20.464627 30343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:20.465694 30343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "79c8db297f5e4561902e5b7d55b1faf1"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "603268131fbbad98678f059b4f81e47f"
server_key_iv: "c3fc100ea4308ee0fad4ab7ce4a4b1a6"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.466078 30343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "79c8db297f5e4561902e5b7d55b1faf1"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "603268131fbbad98678f059b4f81e47f"
server_key_iv: "c3fc100ea4308ee0fad4ab7ce4a4b1a6"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.467437 30343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:20.468210 30369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.468432 30343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:20.468550 30343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "79c8db297f5e4561902e5b7d55b1faf1"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "603268131fbbad98678f059b4f81e47f"
server_key_iv: "c3fc100ea4308ee0fad4ab7ce4a4b1a6"
server_key_version: "encryptionkey@0"
I20260812 16:42:20.468613 30343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:20.480715 30343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:20.482798 30343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:20.482919 30343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:20.483114 30343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:20.483413 30343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:20.483448 30343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.483471 30343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:20.483485 30343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:20.490103 30343 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:41881
I20260812 16:42:20.490195 30587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:41881 every 8 connection(s)
I20260812 16:42:20.490470 30343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:20.492743 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30343
I20260812 16:42:20.492900 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:20.493090 21961 external_mini_cluster.cc:1428] Setting key 4a184239359187b24da52fb165abce55
Aug 12 16:42:20 dist-test-slave-45dx krb5kdc[29667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552940, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:20.500588 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.491292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:33113 (local address 127.21.114.126:38331)
0812 16:42:20.491363 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.491365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.491570 (+ 205us) server_negotiation.cc:407] Connection header received
0812 16:42:20.492152 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.492153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.492165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.492231 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:20.493514 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.494245 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.495310 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.495502 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.495556 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.497797 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:20.497798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:20.497798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:20.497805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:20.499231 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.499621 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.499622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.499623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.499677 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.499922 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.499922 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.499922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.500026 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:20.500077 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.500400 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.500488 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:42:20.500702 30592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.491262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38331 (local address 127.21.114.67:33113)
0812 16:42:20.491436 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.491479 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.492010 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.492358 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.492362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.492639 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:20.493406 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.493418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.494317 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.494318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.495235 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.495238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.495577 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.495578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.495690 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.496169 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:20.496178 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:20.497706 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:20.499310 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:20.499317 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:20.499319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:20.499550 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:20.499741 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:20.499742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:20.499742 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:20.499861 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:20.500086 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:20.500090 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:20.500210 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.500356 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.500503 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260812 16:42:20.501204 30589 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38331
I20260812 16:42:20.501295 30589 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:20.501410 30589 heartbeater.cc:511] Master 127.21.114.126:38331 requested a full tablet report, sending...
I20260812 16:42:20.501801 29745 ts_manager.cc:194] Registered new tserver with Master: 79c8db297f5e4561902e5b7d55b1faf1 (127.21.114.67:41881)
I20260812 16:42:20.502177 29745 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:33113
I20260812 16:42:20.505016 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:42:20.519191 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.506270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53628 (local address 127.21.114.126:38331)
0812 16:42:20.506328 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.506329 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.506429 (+ 100us) server_negotiation.cc:407] Connection header received
0812 16:42:20.506474 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.506474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.506482 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.506528 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:20.507091 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.507557 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.508444 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.508617 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.508664 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.516053 (+ 7389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:20.516055 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:20.516055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:20.516062 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:20.517933 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.518281 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.518282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.518282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.518341 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:20.518513 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:20.518514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:20.518514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:20.518660 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:20.518742 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.518847 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.519088 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:42:20.521088 29745 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:20.522825 29745 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:20.529778 30611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.525372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36011 (local address 127.0.0.1:35604)
0812 16:42:20.525683 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.525694 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.525749 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.526074 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.526078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.526080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:20.526182 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.526184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.527587 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.527588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.528678 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.528681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.529523 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.529524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.529597 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.529609 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.529673 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.529713 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":90,"thread_start_us":111,"threads_started":1}
I20260812 16:42:20.529838 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.525590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35604 (local address 127.21.114.66:36011)
0812 16:42:20.525864 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.525871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.525884 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:42:20.525930 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.525933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.525950 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.526037 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:20.526271 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.527466 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.528770 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.529435 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.529515 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.529572 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.529707 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.529748 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":106,"threads_started":1}
I20260812 16:42:20.530623 30612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.525365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:35471 (local address 127.0.0.1:55316)
0812 16:42:20.525546 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.525594 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.525672 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.526446 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.526447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.526449 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:20.526500 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.526502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.527440 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.527441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.528986 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.528989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.530354 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.530355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.530406 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.530409 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.530507 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.530552 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":6,"thread_start_us":75,"threads_started":1}
I20260812 16:42:20.530658 30615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.525511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55316 (local address 127.21.114.65:35471)
0812 16:42:20.526193 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.526198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.526208 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:20.526249 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.526252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.526269 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.526352 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:20.526565 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.527321 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.529081 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.529792 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.529888 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.529945 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.530531 (+ 586us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.530575 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":83,"threads_started":1}
I20260812 16:42:20.530848 30212 tablet_service.cc:1467] Processing CreateTablet for tablet 684c6cc925aa46b296488564ca2d8296 (DEFAULT_TABLE table=test-table [id=f0a6b44e699d47178d39903e2f5138ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:20.531021 30616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.525603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:41881 (local address 127.0.0.1:50840)
0812 16:42:20.525838 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.525846 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.525881 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.526267 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.526268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.526270 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:20.526323 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.526324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.527686 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.527686 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.528986 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.528989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.530760 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.530761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.530841 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.530846 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.530909 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.530950 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":10,"thread_start_us":71,"threads_started":1}
I20260812 16:42:20.531113 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.525827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50840 (local address 127.21.114.67:41881)
0812 16:42:20.526031 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.526036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.526046 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:20.526084 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.526086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.526102 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.526182 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:20.526402 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.527468 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.529984 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.530549 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.530619 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.530669 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.530947 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.531007 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260812 16:42:20.531296 30212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 684c6cc925aa46b296488564ca2d8296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:20.531682 29978 tablet_service.cc:1467] Processing CreateTablet for tablet 684c6cc925aa46b296488564ca2d8296 (DEFAULT_TABLE table=test-table [id=f0a6b44e699d47178d39903e2f5138ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:20.531855 30468 tablet_service.cc:1467] Processing CreateTablet for tablet 684c6cc925aa46b296488564ca2d8296 (DEFAULT_TABLE table=test-table [id=f0a6b44e699d47178d39903e2f5138ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:20.532087 29978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 684c6cc925aa46b296488564ca2d8296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:20.532195 30468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 684c6cc925aa46b296488564ca2d8296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:20.534972 30623 tablet_bootstrap.cc:492] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Bootstrap starting.
I20260812 16:42:20.535584 30626 tablet_bootstrap.cc:492] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Bootstrap starting.
I20260812 16:42:20.535820 30625 tablet_bootstrap.cc:492] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: Bootstrap starting.
I20260812 16:42:20.536038 30623 tablet_bootstrap.cc:654] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:20.536331 30626 tablet_bootstrap.cc:654] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:20.536530 30625 tablet_bootstrap.cc:654] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:20.536823 30623 log.cc:824] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:20.537040 30626 log.cc:824] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:20.537129 30625 log.cc:824] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:20.537716 30623 tablet_bootstrap.cc:492] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: No bootstrap required, opened a new log
I20260812 16:42:20.537812 30623 ts_tablet_manager.cc:1397] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:42:20.537860 30626 tablet_bootstrap.cc:492] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: No bootstrap required, opened a new log
I20260812 16:42:20.537955 30626 ts_tablet_manager.cc:1397] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:20.539268 30626 raft_consensus.cc:348] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.539441 30626 raft_consensus.cc:374] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:20.539490 30626 raft_consensus.cc:729] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c8db297f5e4561902e5b7d55b1faf1, State: Initialized, Role: FOLLOWER
I20260812 16:42:20.539613 30626 consensus_queue.cc:260] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.539680 30623 raft_consensus.cc:348] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.539865 30623 raft_consensus.cc:374] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:20.539920 30623 raft_consensus.cc:729] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a1efc9c5087468dbec18d7ecf057c7f, State: Initialized, Role: FOLLOWER
I20260812 16:42:20.539915 30626 ts_tablet_manager.cc:1428] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:20.539927 30589 heartbeater.cc:503] Master 127.21.114.126:38331 was elected leader, sending a full tablet report...
I20260812 16:42:20.540047 30623 consensus_queue.cc:260] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.540393 30332 heartbeater.cc:503] Master 127.21.114.126:38331 was elected leader, sending a full tablet report...
I20260812 16:42:20.540398 30623 ts_tablet_manager.cc:1428] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:20.540901 30625 tablet_bootstrap.cc:492] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: No bootstrap required, opened a new log
I20260812 16:42:20.540971 30625 ts_tablet_manager.cc:1397] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 16:42:20.542455 30625 raft_consensus.cc:348] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.542582 30625 raft_consensus.cc:374] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:20.542603 30625 raft_consensus.cc:729] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2551ba7b86c248d9bddefdf4a1d2fc32, State: Initialized, Role: FOLLOWER
I20260812 16:42:20.542718 30625 consensus_queue.cc:260] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.543030 30625 ts_tablet_manager.cc:1428] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:20.543084 30094 heartbeater.cc:503] Master 127.21.114.126:38331 was elected leader, sending a full tablet report...
W20260812 16:42:20.582319 30333 tablet.cc:2369] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:20.664388 30095 tablet.cc:2369] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:20.741070 30591 tablet.cc:2369] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:20.772054 30641 raft_consensus.cc:482] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:20.772195 30641 raft_consensus.cc:504] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.772679 30641 leader_election.cc:288] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2551ba7b86c248d9bddefdf4a1d2fc32 (127.21.114.65:35471), 79c8db297f5e4561902e5b7d55b1faf1 (127.21.114.67:41881)
I20260812 16:42:20.775980 30335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.772945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:35471 (local address 127.21.114.66:39769)
0812 16:42:20.773027 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.773043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.773117 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.773289 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.773290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.773292 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:20.773371 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.773373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.774232 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.774233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.775042 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.775044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.775718 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.775719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.775792 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.775797 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.775864 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.775906 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":1}
I20260812 16:42:20.776027 30615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.773050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:39769 (local address 127.21.114.65:35471)
0812 16:42:20.773131 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.773134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.773148 (+ 14us) server_negotiation.cc:407] Connection header received
0812 16:42:20.773187 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.773188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.773202 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.773281 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:20.773466 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.774140 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.775145 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.775631 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.775692 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.775700 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.775901 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.775941 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 16:42:20.776221 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.773287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:34183 (local address 127.21.114.67:41881)
0812 16:42:20.773344 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.773346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.773388 (+ 42us) server_negotiation.cc:407] Connection header received
0812 16:42:20.773498 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.773499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.773513 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.773558 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:20.773760 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.774262 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.775358 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.775800 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.775882 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.775889 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.776099 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.776150 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 16:42:20.776475 30647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.773105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:41881 (local address 127.21.114.66:34183)
0812 16:42:20.773329 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.773340 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:20.773400 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:20.773599 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:20.773600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:20.773602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:20.773683 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.773685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.774362 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.774363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.775255 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:20.775258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.775908 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.775909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:20.775986 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.775992 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:42:20.776347 (+ 355us) client_negotiation.cc:240] Negotiation successful
0812 16:42:20.776399 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":133,"threads_started":1}
I20260812 16:42:20.776463 30014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "684c6cc925aa46b296488564ca2d8296" candidate_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" is_pre_election: true
I20260812 16:42:20.776640 30014 raft_consensus.cc:2454] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a1efc9c5087468dbec18d7ecf057c7f in term 0.
I20260812 16:42:20.776890 30123 leader_election.cc:302] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2551ba7b86c248d9bddefdf4a1d2fc32, 8a1efc9c5087468dbec18d7ecf057c7f; no voters:
I20260812 16:42:20.776861 30504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "684c6cc925aa46b296488564ca2d8296" candidate_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c8db297f5e4561902e5b7d55b1faf1" is_pre_election: true
I20260812 16:42:20.777040 30504 raft_consensus.cc:2454] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a1efc9c5087468dbec18d7ecf057c7f in term 0.
I20260812 16:42:20.777067 30641 raft_consensus.cc:2781] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:20.777166 30641 raft_consensus.cc:482] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:20.777216 30641 raft_consensus.cc:3037] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:20.777958 30641 raft_consensus.cc:504] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.778108 30641 leader_election.cc:288] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [CANDIDATE]: Term 1 election: Requested vote from peers 2551ba7b86c248d9bddefdf4a1d2fc32 (127.21.114.65:35471), 79c8db297f5e4561902e5b7d55b1faf1 (127.21.114.67:41881)
I20260812 16:42:20.778270 30014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "684c6cc925aa46b296488564ca2d8296" candidate_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32"
I20260812 16:42:20.778292 30504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "684c6cc925aa46b296488564ca2d8296" candidate_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c8db297f5e4561902e5b7d55b1faf1"
I20260812 16:42:20.778352 30014 raft_consensus.cc:3037] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:20.778367 30504 raft_consensus.cc:3037] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:20.779124 30504 raft_consensus.cc:2454] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a1efc9c5087468dbec18d7ecf057c7f in term 1.
I20260812 16:42:20.779143 30014 raft_consensus.cc:2454] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a1efc9c5087468dbec18d7ecf057c7f in term 1.
I20260812 16:42:20.779304 30123 leader_election.cc:302] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2551ba7b86c248d9bddefdf4a1d2fc32, 8a1efc9c5087468dbec18d7ecf057c7f; no voters:
I20260812 16:42:20.779444 30641 raft_consensus.cc:2781] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:20.779656 30641 raft_consensus.cc:686] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 1 LEADER]: Becoming Leader. State: Replica: 8a1efc9c5087468dbec18d7ecf057c7f, State: Running, Role: LEADER
I20260812 16:42:20.779767 30641 consensus_queue.cc:237] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } }
I20260812 16:42:20.780727 29747 catalog_manager.cc:5495] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a1efc9c5087468dbec18d7ecf057c7f (127.21.114.66). New cstate: current_term: 1 leader_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a1efc9c5087468dbec18d7ecf057c7f" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:20.814143 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.811770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35610 (local address 127.21.114.66:36011)
0812 16:42:20.811837 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:20.811839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:20.811850 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:20.811901 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:20.811901 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:20.811919 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:20.811986 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:20.812132 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.812621 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.813431 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:20.813615 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:20.813670 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:20.813835 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:20.813941 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:20.814004 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:20.814046 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 16:42:20.814065 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:42:20.816068 30504 raft_consensus.cc:1261] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 1 FOLLOWER]: Refusing update from remote peer 8a1efc9c5087468dbec18d7ecf057c7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:20.816119 30014 raft_consensus.cc:1261] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 1 FOLLOWER]: Refusing update from remote peer 8a1efc9c5087468dbec18d7ecf057c7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:20.816483 30641 consensus_queue.cc:1035] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2551ba7b86c248d9bddefdf4a1d2fc32" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:20.816644 30648 consensus_queue.cc:1035] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c8db297f5e4561902e5b7d55b1faf1" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:20.819368 30654 mvcc.cc:205] Tried to move back new op lower bound from 7317720845579538432 to 7317720845434654720. Current Snapshot: MvccSnapshot[applied={T|T < 7317720845579538432}]
I20260812 16:42:20.819691 30655 mvcc.cc:205] Tried to move back new op lower bound from 7317720845579538432 to 7317720845434654720. Current Snapshot: MvccSnapshot[applied={T|T < 7317720845579538432}]
I20260812 16:42:20.819728 30656 mvcc.cc:205] Tried to move back new op lower bound from 7317720845579538432 to 7317720845434654720. Current Snapshot: MvccSnapshot[applied={T|T < 7317720845579538432}]
I20260812 16:42:20.822513 29747 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:20.822620 29747 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:20.823403 29747 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3238f51bbc148ea983f47933c17bd02: Sending DeleteTablet for 3 replicas of tablet 684c6cc925aa46b296488564ca2d8296
I20260812 16:42:20.823704 30212 tablet_service.cc:1514] Processing DeleteTablet for tablet 684c6cc925aa46b296488564ca2d8296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:20 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:35604
I20260812 16:42:20.823855 29978 tablet_service.cc:1514] Processing DeleteTablet for tablet 684c6cc925aa46b296488564ca2d8296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:20 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:55316
I20260812 16:42:20.823961 30664 tablet_replica.cc:330] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: stopping tablet replica
I20260812 16:42:20.824062 30664 raft_consensus.cc:2229] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:20.824097 30468 tablet_service.cc:1514] Processing DeleteTablet for tablet 684c6cc925aa46b296488564ca2d8296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:20 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:50840
I20260812 16:42:20.824187 30664 raft_consensus.cc:2258] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:20.824504 30669 tablet_replica.cc:330] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32: stopping tablet replica
I20260812 16:42:20.824612 30669 raft_consensus.cc:2229] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:20.824712 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29868
I20260812 16:42:20.824643 30664 ts_tablet_manager.cc:1905] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:20.824733 30669 raft_consensus.cc:2258] T 684c6cc925aa46b296488564ca2d8296 P 2551ba7b86c248d9bddefdf4a1d2fc32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:20.832197 30664 ts_tablet_manager.cc:1918] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:20.832267 30664 log.cc:1196] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/684c6cc925aa46b296488564ca2d8296
I20260812 16:42:20.832670 30664 ts_tablet_manager.cc:1939] T 684c6cc925aa46b296488564ca2d8296 P 8a1efc9c5087468dbec18d7ecf057c7f: Deleting consensus metadata
I20260812 16:42:20.824429 30670 tablet_replica.cc:330] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: stopping tablet replica
I20260812 16:42:20.837481 30670 raft_consensus.cc:2229] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:20.837636 30670 raft_consensus.cc:2258] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:20.838307 30670 ts_tablet_manager.cc:1905] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:20.840092 30670 ts_tablet_manager.cc:1918] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:20.840179 30670 log.cc:1196] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/684c6cc925aa46b296488564ca2d8296
I20260812 16:42:20.840415 29724 catalog_manager.cc:4841] TS 8a1efc9c5087468dbec18d7ecf057c7f (127.21.114.66:36011): tablet 684c6cc925aa46b296488564ca2d8296 (table test-table [id=f0a6b44e699d47178d39903e2f5138ea]) successfully deleted
I20260812 16:42:20.840538 30670 ts_tablet_manager.cc:1939] T 684c6cc925aa46b296488564ca2d8296 P 79c8db297f5e4561902e5b7d55b1faf1: Deleting consensus metadata
I20260812 16:42:20.841089 29716 catalog_manager.cc:4841] TS 79c8db297f5e4561902e5b7d55b1faf1 (127.21.114.67:41881): tablet 684c6cc925aa46b296488564ca2d8296 (table test-table [id=f0a6b44e699d47178d39903e2f5138ea]) successfully deleted
W20260812 16:42:20.842249 29716 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:35471 (error 108)
I20260812 16:42:20.842885 30612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:20.842722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:35471 (local address 127.0.0.1:55330)
0812 16:42:20.842796 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:20.842848 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 16:42:20.842970 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30101
W20260812 16:42:20.847627 29716 catalog_manager.cc:4584] TS 2551ba7b86c248d9bddefdf4a1d2fc32 (127.21.114.65:35471): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 684c6cc925aa46b296488564ca2d8296: Network error: Client connection negotiation failed: client connection to 127.21.114.65:35471: connect: Connection refused (error 111)
I20260812 16:42:20.859828 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30343
I20260812 16:42:20.872460 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29688
2026-08-12T16:42:20Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2504 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T16:42:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:20Z Disabled control of system clock
I20260812 16:42:20.908988 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33847
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:42271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 16:42:20.991325 30681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:20.991535 30681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:20.991556 30681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:20.992702 30681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:20.992745 30681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:20.992758 30681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:20.992770 30681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:20.992782 30681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:20.994151 30681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:20.994342 30681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:20.994585 30681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:20.999469 30696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:20.999478 30692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:20.999562 30681 server_base.cc:1034] running on GCE node
W20260812 16:42:20.999481 30691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:21.000087 30681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:21.000443 30681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:21.001622 30681 hybrid_clock.cc:648] HybridClock initialized: now 1786552941001613 us; error 37 us; skew 500 ppm
I20260812 16:42:21.002929 30681 webserver.cc:460] Webserver started at http://127.21.114.126:34755/ using document root <none> and password file <none>
I20260812 16:42:21.003197 30681 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:21.003283 30681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:21.003435 30681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:21.004590 30681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "71ee5594c71a4b6c91aa566fda3bf4e8"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "777ef345b95301fde44711b2218a05c5"
server_key_iv: "8b9dd06a6814c8d06c785222a0fbfa0a"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.004968 30681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "71ee5594c71a4b6c91aa566fda3bf4e8"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "777ef345b95301fde44711b2218a05c5"
server_key_iv: "8b9dd06a6814c8d06c785222a0fbfa0a"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.006304 30681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:21.007097 30704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.007283 30681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:21.007395 30681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "71ee5594c71a4b6c91aa566fda3bf4e8"
format_stamp: "Formatted at 2026-08-12 16:42:20 on dist-test-slave-45dx"
server_key: "777ef345b95301fde44711b2218a05c5"
server_key_iv: "8b9dd06a6814c8d06c785222a0fbfa0a"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.007472 30681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:21.010936 30681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:21.011193 30681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:21.011341 30681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:21.015260 30681 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33847
I20260812 16:42:21.015296 30808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33847 every 8 connection(s)
I20260812 16:42:21.015621 30681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:21.016369 30809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:21.019096 30809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8: Bootstrap starting.
I20260812 16:42:21.019693 30809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:21.020004 30809 log.cc:824] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:21.020769 30809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8: No bootstrap required, opened a new log
I20260812 16:42:21.022387 30809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33847 } }
I20260812 16:42:21.022518 30809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:21.022540 30809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ee5594c71a4b6c91aa566fda3bf4e8, State: Initialized, Role: FOLLOWER
I20260812 16:42:21.022689 30809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33847 } }
I20260812 16:42:21.022761 30809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:21.022782 30809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:21.022830 30809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:21.023437 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30681
I20260812 16:42:21.023458 30809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33847 } }
I20260812 16:42:21.023550 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:21.023562 30809 leader_election.cc:302] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71ee5594c71a4b6c91aa566fda3bf4e8; no voters:
I20260812 16:42:21.023726 30809 leader_election.cc:288] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:21.023763 21961 external_mini_cluster.cc:1428] Setting key 5d54d96f93792bd7ce6d3b980ba02fef
I20260812 16:42:21.023809 30812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:21.023974 30812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 71ee5594c71a4b6c91aa566fda3bf4e8, State: Running, Role: LEADER
I20260812 16:42:21.023990 30809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:21.024060 30812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33847 } }
I20260812 16:42:21.024405 30812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71ee5594c71a4b6c91aa566fda3bf4e8. Latest consensus state: current_term: 1 leader_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33847 } } }
I20260812 16:42:21.024495 30812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:21.024784 30813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71ee5594c71a4b6c91aa566fda3bf4e8" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33847 } } }
I20260812 16:42:21.024915 30813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:21.025346 30826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:21.026012 30826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:21.026898 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.024369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.21.114.126:33847)
0812 16:42:21.024831 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.024855 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.024889 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:42:21.025006 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.025013 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.025064 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.025216 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.026419 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.026423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.026423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.026429 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.026475 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.026490 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.026571 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.026646 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.026704 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":95,"threads_started":1}
I20260812 16:42:21.027850 30826 catalog_manager.cc:1347] Generated new cluster ID: 1599a3c2279d47f5826063cdb24dae39
I20260812 16:42:21.027905 30826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:21.056371 30826 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:21.056602 30826 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:21.059000 30826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8: Generated new TSK 0
I20260812 16:42:21.059221 30826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:21.060931 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33847
--builtin_ntp_servers=127.21.114.84:42271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 16:42:21.146756 30855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:21.146996 30855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:21.147035 30855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:21.148195 30855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:21.148262 30855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:21.148343 30855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:21.149708 30855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:21.149945 30855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:21.150266 30855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:21.156358 30863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.156373 30864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.156466 30867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:21.156991 30855 server_base.cc:1034] running on GCE node
I20260812 16:42:21.157243 30855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:21.157485 30855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:21.158650 30855 hybrid_clock.cc:648] HybridClock initialized: now 1786552941158632 us; error 34 us; skew 500 ppm
I20260812 16:42:21.159986 30855 webserver.cc:460] Webserver started at http://127.21.114.65:42487/ using document root <none> and password file <none>
I20260812 16:42:21.160239 30855 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:21.160329 30855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:21.160482 30855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:21.161552 30855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "87fe374f5c6e47538da28a800dc7209a"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "8fe3e5fbc9b571a42ff9171b82ecb7c8"
server_key_iv: "81b9364d369eb14ef55ffe6abb38aaea"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.161962 30855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "87fe374f5c6e47538da28a800dc7209a"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "8fe3e5fbc9b571a42ff9171b82ecb7c8"
server_key_iv: "81b9364d369eb14ef55ffe6abb38aaea"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.163295 30855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:21.164003 30879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.164243 30855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:21.164403 30855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "87fe374f5c6e47538da28a800dc7209a"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "8fe3e5fbc9b571a42ff9171b82ecb7c8"
server_key_iv: "81b9364d369eb14ef55ffe6abb38aaea"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.164490 30855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:21.168036 30855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:21.168367 30855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:21.168545 30855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:21.168777 30855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:21.169102 30855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:21.169162 30855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.169203 30855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:21.169230 30855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.175110 30855 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:41431
I20260812 16:42:21.175180 31086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:41431 every 8 connection(s)
I20260812 16:42:21.175513 30855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:21.176973 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30855
I20260812 16:42:21.177106 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:21.177284 21961 external_mini_cluster.cc:1428] Setting key a5c9cfd1e39f5b8e05d33d31a8c69de2
I20260812 16:42:21.178236 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33847
--builtin_ntp_servers=127.21.114.84:42271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 16:42:21.178872 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.176353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:57309 (local address 127.21.114.126:33847)
0812 16:42:21.176407 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.176410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.176595 (+ 185us) server_negotiation.cc:407] Connection header received
0812 16:42:21.177171 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.177173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.177181 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.177246 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.178622 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.178623 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.178624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.178628 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.178645 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.178650 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.178703 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.178778 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.178794 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:42:21.179059 31091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.176276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33847 (local address 127.21.114.65:57309)
0812 16:42:21.176482 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.176513 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.177028 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.177320 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.177324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.177333 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.178452 (+ 1119us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.178452 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.178490 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.178530 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.178701 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.178707 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.178711 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.178779 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.178842 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
I20260812 16:42:21.179670 31087 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33847
I20260812 16:42:21.179813 31087 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:21.179982 31087 heartbeater.cc:511] Master 127.21.114.126:33847 requested a full tablet report, sending...
I20260812 16:42:21.180586 30738 ts_manager.cc:194] Registered new tserver with Master: 87fe374f5c6e47538da28a800dc7209a (127.21.114.65:41431)
W20260812 16:42:21.262243 31094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:21.262507 31094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:21.262537 31094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:21.263695 31094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:21.263738 31094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:21.263764 31094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:21.265234 31094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:21.265489 31094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:21.265787 31094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:21.271032 31105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.271062 31110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.271067 31106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:21.271215 31094 server_base.cc:1034] running on GCE node
I20260812 16:42:21.271466 31094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:21.271710 31094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:21.272879 31094 hybrid_clock.cc:648] HybridClock initialized: now 1786552941272863 us; error 28 us; skew 500 ppm
I20260812 16:42:21.274202 31094 webserver.cc:460] Webserver started at http://127.21.114.66:44319/ using document root <none> and password file <none>
I20260812 16:42:21.274457 31094 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:21.274530 31094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:21.274681 31094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:21.275732 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "19afc6e8658f4635b56864b3682ca959"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "fc184bc59ef52dd8c846294ea782ceb7"
server_key_iv: "e196db6854483c529d8ef6326f2f16db"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.276121 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "19afc6e8658f4635b56864b3682ca959"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "fc184bc59ef52dd8c846294ea782ceb7"
server_key_iv: "e196db6854483c529d8ef6326f2f16db"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.277550 31094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:21.278415 31120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.278615 31094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:21.278720 31094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "19afc6e8658f4635b56864b3682ca959"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "fc184bc59ef52dd8c846294ea782ceb7"
server_key_iv: "e196db6854483c529d8ef6326f2f16db"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.278807 31094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:21.282279 31094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:21.282549 31094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:21.282692 31094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:21.282910 31094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:21.283221 31094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:21.283293 31094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.283334 31094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:21.283362 31094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.289256 31094 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:43595
I20260812 16:42:21.289310 31330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:43595 every 8 connection(s)
I20260812 16:42:21.289651 31094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:21.292763 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.290478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:37897 (local address 127.21.114.126:33847)
0812 16:42:21.290575 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.290577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.290812 (+ 235us) server_negotiation.cc:407] Connection header received
0812 16:42:21.291227 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.291228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.291234 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.291297 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.292559 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.292560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.292561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.292564 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.292581 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.292586 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.292655 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.292694 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.292707 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 16:42:21.292975 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.290434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33847 (local address 127.21.114.66:37897)
0812 16:42:21.290659 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.290692 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.291135 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.291346 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.291349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.291357 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.292421 (+ 1064us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.292422 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.292449 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.292477 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.292646 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.292648 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.292651 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.292700 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.292746 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":121,"threads_started":1}
I20260812 16:42:21.293666 31331 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33847
I20260812 16:42:21.293784 31331 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:21.293949 31331 heartbeater.cc:511] Master 127.21.114.126:33847 requested a full tablet report, sending...
I20260812 16:42:21.294356 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31094
I20260812 16:42:21.294373 30738 ts_manager.cc:194] Registered new tserver with Master: 19afc6e8658f4635b56864b3682ca959 (127.21.114.66:43595)
I20260812 16:42:21.294466 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:21.294680 21961 external_mini_cluster.cc:1428] Setting key d63261efb4df07f2e26c03648da8e49d
I20260812 16:42:21.295749 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33847
--builtin_ntp_servers=127.21.114.84:42271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 16:42:21.384205 31344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:21.384423 31344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:21.384446 31344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:21.385605 31344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:21.385648 31344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:21.385672 31344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:21.387017 31344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:21.387256 31344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:21.387557 31344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:21.392678 31360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:21.392781 31344 server_base.cc:1034] running on GCE node
W20260812 16:42:21.392694 31352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.392740 31356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:21.393126 31344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:21.393378 31344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:21.394546 31344 hybrid_clock.cc:648] HybridClock initialized: now 1786552941394531 us; error 28 us; skew 500 ppm
I20260812 16:42:21.395921 31344 webserver.cc:460] Webserver started at http://127.21.114.67:33601/ using document root <none> and password file <none>
I20260812 16:42:21.396266 31344 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:21.396376 31344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:21.396541 31344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:21.397609 31344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "bb737625bb3647e28beb947465a2449c"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "2ced4da581ce36172ac29624bebde4e0"
server_key_iv: "84939e3f4cd8721d169da7c4c9466d5e"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.397991 31344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "bb737625bb3647e28beb947465a2449c"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "2ced4da581ce36172ac29624bebde4e0"
server_key_iv: "84939e3f4cd8721d169da7c4c9466d5e"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.399325 31344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:21.400032 31369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.400239 31344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:21.400364 31344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "bb737625bb3647e28beb947465a2449c"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "2ced4da581ce36172ac29624bebde4e0"
server_key_iv: "84939e3f4cd8721d169da7c4c9466d5e"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.400457 31344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:21.404072 31344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:21.404376 31344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:21.404522 31344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:21.404737 31344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:21.405045 31344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:21.405098 31344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.405138 31344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:21.405164 31344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.411237 31344 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:43835
I20260812 16:42:21.411268 31589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:43835 every 8 connection(s)
I20260812 16:42:21.411598 31344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:21.414755 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.412393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:46087 (local address 127.21.114.126:33847)
0812 16:42:21.412454 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.412456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.412695 (+ 239us) server_negotiation.cc:407] Connection header received
0812 16:42:21.413213 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.413214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.413222 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.413280 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.414463 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.414465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.414465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.414470 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.414488 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.414493 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.414571 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.414666 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.414683 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 16:42:21.414990 31602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.412376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33847 (local address 127.21.114.67:46087)
0812 16:42:21.412571 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.412604 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.413099 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.413361 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.413366 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.413375 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.414304 (+ 929us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.414305 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.414332 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.414363 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.414571 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.414578 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.414581 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.414675 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.414739 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260812 16:42:21.415530 31590 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33847
I20260812 16:42:21.415609 31590 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:21.415781 31590 heartbeater.cc:511] Master 127.21.114.126:33847 requested a full tablet report, sending...
I20260812 16:42:21.416170 30738 ts_manager.cc:194] Registered new tserver with Master: bb737625bb3647e28beb947465a2449c (127.21.114.67:43835)
I20260812 16:42:21.421429 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31344
I20260812 16:42:21.421519 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:21.421665 21961 external_mini_cluster.cc:1428] Setting key 06c7678fabe41c3d00e8bc0e9497ceca
I20260812 16:42:21.422364 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:42:21.424863 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.423650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51292 (local address 127.21.114.126:33847)
0812 16:42:21.423731 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.423733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.423848 (+ 115us) server_negotiation.cc:407] Connection header received
0812 16:42:21.423919 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.423920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.423926 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.424017 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.424637 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.424638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.424638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.424642 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.424657 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.424661 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.424708 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.424742 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.424754 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 16:42:21.426616 30738 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:21.428100 30738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:21.432327 31609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.430548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:43835 (local address 127.0.0.1:39170)
0812 16:42:21.430726 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.430765 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.430823 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.431233 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.431234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.431255 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.431772 (+ 517us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.431773 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.431789 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.431813 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.432124 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.432132 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.432135 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.432200 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.432215 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":56,"threads_started":1}
I20260812 16:42:21.432432 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.430576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:43595 (local address 127.0.0.1:37380)
0812 16:42:21.430919 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.430928 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.430962 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.431395 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.431396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.431398 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.431999 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.432000 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.432008 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.432023 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.432260 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.432261 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.432262 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.432289 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.432321 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":101,"threads_started":1}
I20260812 16:42:21.432590 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.430615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.21.114.67:43835)
0812 16:42:21.431074 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.431079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.431090 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:21.431116 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.431118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.431127 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.431542 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.431986 (+ 444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.431988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.431989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.431991 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.432051 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.432067 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.432130 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.432383 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.432401 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":77,"threads_started":1}
I20260812 16:42:21.432628 31616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.431051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37380 (local address 127.21.114.66:43595)
0812 16:42:21.431242 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.431246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.431255 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:21.431280 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.431282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.431291 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.431532 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.432093 (+ 561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.432102 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.432102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.432108 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.432147 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.432179 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.432490 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.432523 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.432541 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":84,"threads_started":1}
I20260812 16:42:21.432936 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.430574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41431 (local address 127.0.0.1:55348)
0812 16:42:21.430832 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.430851 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.430898 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.431170 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.431178 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.431185 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.432203 (+ 1018us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.432203 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.432210 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.432222 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.432799 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.432800 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.432801 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.432860 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.432873 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":99,"threads_started":1}
I20260812 16:42:21.433207 31615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.430822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55348 (local address 127.21.114.65:41431)
0812 16:42:21.431036 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.431040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.431048 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:21.431070 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.431072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.431079 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.431166 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.432343 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.432351 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.432351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.432356 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.432673 (+ 317us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.432704 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.432770 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.433106 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.433123 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":122,"threads_started":1}
I20260812 16:42:21.433254 31464 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa7fa3408ca4c139c0fdddc378ab062 (DEFAULT_TABLE table=test-table [id=902906aa5e5a446a8c5e28880f74ac5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:21.433336 31211 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa7fa3408ca4c139c0fdddc378ab062 (DEFAULT_TABLE table=test-table [id=902906aa5e5a446a8c5e28880f74ac5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:21.433650 31464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa7fa3408ca4c139c0fdddc378ab062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:21.433729 31211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa7fa3408ca4c139c0fdddc378ab062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:21.433848 30966 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa7fa3408ca4c139c0fdddc378ab062 (DEFAULT_TABLE table=test-table [id=902906aa5e5a446a8c5e28880f74ac5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:21.434146 30966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa7fa3408ca4c139c0fdddc378ab062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:21.435990 31618 tablet_bootstrap.cc:492] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Bootstrap starting.
I20260812 16:42:21.436703 31618 tablet_bootstrap.cc:654] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:21.437031 31618 log.cc:824] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:21.437188 31624 tablet_bootstrap.cc:492] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Bootstrap starting.
I20260812 16:42:21.437589 31627 tablet_bootstrap.cc:492] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: Bootstrap starting.
I20260812 16:42:21.437790 31618 tablet_bootstrap.cc:492] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: No bootstrap required, opened a new log
I20260812 16:42:21.437863 31624 tablet_bootstrap.cc:654] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:21.437883 31618 ts_tablet_manager.cc:1397] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 16:42:21.438180 31624 log.cc:824] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:21.438225 31627 tablet_bootstrap.cc:654] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:21.438580 31627 log.cc:824] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:21.438952 31624 tablet_bootstrap.cc:492] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: No bootstrap required, opened a new log
I20260812 16:42:21.439036 31624 ts_tablet_manager.cc:1397] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:21.439448 31627 tablet_bootstrap.cc:492] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: No bootstrap required, opened a new log
I20260812 16:42:21.439563 31627 ts_tablet_manager.cc:1397] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:21.440244 31618 raft_consensus.cc:348] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.440474 31618 raft_consensus.cc:374] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:21.440524 31618 raft_consensus.cc:729] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb737625bb3647e28beb947465a2449c, State: Initialized, Role: FOLLOWER
I20260812 16:42:21.440637 31618 consensus_queue.cc:260] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.440924 31618 ts_tablet_manager.cc:1428] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 16:42:21.441077 31590 heartbeater.cc:503] Master 127.21.114.126:33847 was elected leader, sending a full tablet report...
I20260812 16:42:21.441710 31624 raft_consensus.cc:348] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.441907 31624 raft_consensus.cc:374] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:21.441957 31624 raft_consensus.cc:729] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19afc6e8658f4635b56864b3682ca959, State: Initialized, Role: FOLLOWER
I20260812 16:42:21.442066 31624 consensus_queue.cc:260] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.442368 31624 ts_tablet_manager.cc:1428] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 16:42:21.442560 31331 heartbeater.cc:503] Master 127.21.114.126:33847 was elected leader, sending a full tablet report...
I20260812 16:42:21.442917 31627 raft_consensus.cc:348] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.443095 31627 raft_consensus.cc:374] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:21.443132 31627 raft_consensus.cc:729] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87fe374f5c6e47538da28a800dc7209a, State: Initialized, Role: FOLLOWER
I20260812 16:42:21.443238 31627 consensus_queue.cc:260] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.443493 31627 ts_tablet_manager.cc:1428] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 16:42:21.443542 31087 heartbeater.cc:503] Master 127.21.114.126:33847 was elected leader, sending a full tablet report...
W20260812 16:42:21.540223 31334 tablet.cc:2369] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:21.587920 31638 raft_consensus.cc:482] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:21.588054 31638 raft_consensus.cc:504] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.588500 31638 leader_election.cc:288] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb737625bb3647e28beb947465a2449c (127.21.114.67:43835), 19afc6e8658f4635b56864b3682ca959 (127.21.114.66:43595)
I20260812 16:42:21.589926 31091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.588715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:43595 (local address 127.21.114.65:36195)
0812 16:42:21.588756 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.588769 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.588810 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.589056 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.589057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.589060 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.589536 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.589537 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.589544 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.589557 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.589765 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.589766 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.589767 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.589815 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.589829 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 16:42:21.589947 31616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.588870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:36195 (local address 127.21.114.66:43595)
0812 16:42:21.588924 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.588926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.588936 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:21.588985 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.588987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.588993 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.589048 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.589651 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.589652 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.589652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.589657 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.589679 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.589684 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.589744 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.589846 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.589862 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:42:21.590238 31242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa7fa3408ca4c139c0fdddc378ab062" candidate_uuid: "87fe374f5c6e47538da28a800dc7209a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19afc6e8658f4635b56864b3682ca959" is_pre_election: true
I20260812 16:42:21.590355 31645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.588716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:43835 (local address 127.21.114.65:37383)
0812 16:42:21.589079 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.589091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.589180 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.589521 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.589522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.589525 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:21.589987 (+ 462us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:21.589988 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:21.589994 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:21.590006 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:21.590207 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:21.590208 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:21.590209 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 16:42:21.590270 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 16:42:21.590283 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":145,"thread_start_us":125,"threads_started":1}
I20260812 16:42:21.590368 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.588835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:37383 (local address 127.21.114.67:43835)
0812 16:42:21.588919 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.588921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.589182 (+ 261us) server_negotiation.cc:407] Connection header received
0812 16:42:21.589248 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.589250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.589256 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.589298 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.590109 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.590110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.590111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.590115 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.590131 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.590136 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.590166 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.590278 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.590293 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 16:42:21.590402 31242 raft_consensus.cc:2454] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87fe374f5c6e47538da28a800dc7209a in term 0.
I20260812 16:42:21.590703 30880 leader_election.cc:302] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19afc6e8658f4635b56864b3682ca959, 87fe374f5c6e47538da28a800dc7209a; no voters:
I20260812 16:42:21.590742 31503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa7fa3408ca4c139c0fdddc378ab062" candidate_uuid: "87fe374f5c6e47538da28a800dc7209a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb737625bb3647e28beb947465a2449c" is_pre_election: true
I20260812 16:42:21.590900 31503 raft_consensus.cc:2454] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87fe374f5c6e47538da28a800dc7209a in term 0.
I20260812 16:42:21.590865 31638 raft_consensus.cc:2781] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:21.590940 31638 raft_consensus.cc:482] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:21.590979 31638 raft_consensus.cc:3037] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:21.591759 31638 raft_consensus.cc:504] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.591922 31638 leader_election.cc:288] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [CANDIDATE]: Term 1 election: Requested vote from peers bb737625bb3647e28beb947465a2449c (127.21.114.67:43835), 19afc6e8658f4635b56864b3682ca959 (127.21.114.66:43595)
I20260812 16:42:21.592079 31503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa7fa3408ca4c139c0fdddc378ab062" candidate_uuid: "87fe374f5c6e47538da28a800dc7209a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb737625bb3647e28beb947465a2449c"
I20260812 16:42:21.592100 31242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aa7fa3408ca4c139c0fdddc378ab062" candidate_uuid: "87fe374f5c6e47538da28a800dc7209a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19afc6e8658f4635b56864b3682ca959"
I20260812 16:42:21.592172 31503 raft_consensus.cc:3037] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:21.592170 31242 raft_consensus.cc:3037] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:21.592913 31503 raft_consensus.cc:2454] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87fe374f5c6e47538da28a800dc7209a in term 1.
I20260812 16:42:21.592949 31242 raft_consensus.cc:2454] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87fe374f5c6e47538da28a800dc7209a in term 1.
I20260812 16:42:21.593142 30881 leader_election.cc:302] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87fe374f5c6e47538da28a800dc7209a, bb737625bb3647e28beb947465a2449c; no voters:
I20260812 16:42:21.593237 31638 raft_consensus.cc:2781] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:21.593377 31638 raft_consensus.cc:686] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 1 LEADER]: Becoming Leader. State: Replica: 87fe374f5c6e47538da28a800dc7209a, State: Running, Role: LEADER
I20260812 16:42:21.593452 31638 consensus_queue.cc:237] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } }
I20260812 16:42:21.594290 30738 catalog_manager.cc:5495] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a reported cstate change: term changed from 0 to 1, leader changed from <none> to 87fe374f5c6e47538da28a800dc7209a (127.21.114.65). New cstate: current_term: 1 leader_uuid: "87fe374f5c6e47538da28a800dc7209a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87fe374f5c6e47538da28a800dc7209a" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:21.618050 31615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.616998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.21.114.65:41431)
0812 16:42:21.617061 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.617063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.617071 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:21.617138 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.617139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.617153 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.617194 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.617779 (+ 585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.617780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.617780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.617784 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.617799 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.617803 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.617866 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.617921 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.617952 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:42:21.619907 31242 raft_consensus.cc:1261] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 1 FOLLOWER]: Refusing update from remote peer 87fe374f5c6e47538da28a800dc7209a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:21.619917 31503 raft_consensus.cc:1261] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 1 FOLLOWER]: Refusing update from remote peer 87fe374f5c6e47538da28a800dc7209a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:21.620273 31638 consensus_queue.cc:1035] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19afc6e8658f4635b56864b3682ca959" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 43595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:21.620510 31648 consensus_queue.cc:1035] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb737625bb3647e28beb947465a2449c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:21.622742 31652 mvcc.cc:205] Tried to move back new op lower bound from 7317720848872411136 to 7317720848767418368. Current Snapshot: MvccSnapshot[applied={T|T < 7317720848872411136}]
I20260812 16:42:21.623028 31653 mvcc.cc:205] Tried to move back new op lower bound from 7317720848872411136 to 7317720848767418368. Current Snapshot: MvccSnapshot[applied={T|T < 7317720848872411136}]
I20260812 16:42:21.624425 31655 mvcc.cc:205] Tried to move back new op lower bound from 7317720848872411136 to 7317720848767418368. Current Snapshot: MvccSnapshot[applied={T|T < 7317720848872411136}]
I20260812 16:42:21.625471 30738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:21.625578 30738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:21.626358 30738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71ee5594c71a4b6c91aa566fda3bf4e8: Sending DeleteTablet for 3 replicas of tablet 3aa7fa3408ca4c139c0fdddc378ab062
I20260812 16:42:21.626672 31211 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa7fa3408ca4c139c0fdddc378ab062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:21 UTC) from {username='slave'} at 127.0.0.1:37380
I20260812 16:42:21.626680 31464 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa7fa3408ca4c139c0fdddc378ab062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:21 UTC) from {username='slave'} at 127.0.0.1:39170
I20260812 16:42:21.626991 31664 tablet_replica.cc:330] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: stopping tablet replica
I20260812 16:42:21.627003 30966 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aa7fa3408ca4c139c0fdddc378ab062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:21 UTC) from {username='slave'} at 127.0.0.1:55348
I20260812 16:42:21.627067 31664 raft_consensus.cc:2229] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:21.627134 31664 raft_consensus.cc:2258] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:21.627269 31667 tablet_replica.cc:330] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: stopping tablet replica
I20260812 16:42:21.627313 31666 tablet_replica.cc:330] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: stopping tablet replica
I20260812 16:42:21.627357 31667 raft_consensus.cc:2229] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:21.627383 31666 raft_consensus.cc:2229] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:21.627439 31667 raft_consensus.cc:2258] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:21.627465 31666 raft_consensus.cc:2258] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:21.627687 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30855
I20260812 16:42:21.627975 31667 ts_tablet_manager.cc:1905] T 3aa7fa3408ca4c139c0fdddc378ab062 P 87fe374f5c6e47538da28a800dc7209a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:21.628003 31664 ts_tablet_manager.cc:1905] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:21.631453 31664 ts_tablet_manager.cc:1918] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:21.631593 31664 log.cc:1196] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/3aa7fa3408ca4c139c0fdddc378ab062
I20260812 16:42:21.631910 31664 ts_tablet_manager.cc:1939] T 3aa7fa3408ca4c139c0fdddc378ab062 P 19afc6e8658f4635b56864b3682ca959: Deleting consensus metadata
I20260812 16:42:21.633756 30705 catalog_manager.cc:4841] TS 19afc6e8658f4635b56864b3682ca959 (127.21.114.66:43595): tablet 3aa7fa3408ca4c139c0fdddc378ab062 (table test-table [id=902906aa5e5a446a8c5e28880f74ac5c]) successfully deleted
I20260812 16:42:21.636823 31666 ts_tablet_manager.cc:1905] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:21.638751 31666 ts_tablet_manager.cc:1918] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:21.638835 31666 log.cc:1196] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/3aa7fa3408ca4c139c0fdddc378ab062
I20260812 16:42:21.639094 31666 ts_tablet_manager.cc:1939] T 3aa7fa3408ca4c139c0fdddc378ab062 P bb737625bb3647e28beb947465a2449c: Deleting consensus metadata
I20260812 16:42:21.639554 30706 catalog_manager.cc:4841] TS bb737625bb3647e28beb947465a2449c (127.21.114.67:43835): tablet 3aa7fa3408ca4c139c0fdddc378ab062 (table test-table [id=902906aa5e5a446a8c5e28880f74ac5c]) successfully deleted
W20260812 16:42:21.641968 30708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:41431 (error 108)
I20260812 16:42:21.642285 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31094
I20260812 16:42:21.642567 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.642400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:41431 (local address 127.0.0.1:55358)
0812 16:42:21.642475 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.642526 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:41431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 16:42:21.643029 30708 catalog_manager.cc:4584] TS 87fe374f5c6e47538da28a800dc7209a (127.21.114.65:41431): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3aa7fa3408ca4c139c0fdddc378ab062: Network error: Client connection negotiation failed: client connection to 127.21.114.65:41431: connect: Connection refused (error 111)
I20260812 16:42:21.650928 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31344
I20260812 16:42:21.660786 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30681
2026-08-12T16:42:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (785 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 16:42:21.686930 21961 mini_oidc.cc:152] Starting JWKS server
I20260812 16:42:21.688148 21961 webserver.cc:460] Webserver started at https://127.0.0.1:45297/ using document root <none> and password file <none>
I20260812 16:42:21.688280 21961 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 16:42:21.688541 21961 webserver.cc:460] Webserver started at http://127.0.0.1:44123/ using document root <none> and password file <none>
2026-08-12T16:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:21Z Disabled control of system clock
I20260812 16:42:21.696972 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:41099
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:41099
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45297/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/testchainca.cert with env {}
W20260812 16:42:21.778666 31681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:21.778873 31681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:21.778896 31681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:21.780011 31681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:21.780047 31681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:21.780061 31681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:21.780072 31681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:21.780085 31681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 16:42:21.780097 31681 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 16:42:21.780108 31681 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45297/jwks.json
I20260812 16:42:21.781715 31681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:41099
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:41099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45297/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:21.781926 31681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:21.782091 31681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:21.787103 31689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.787122 31690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:21.787103 31697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:21.787349 31681 server_base.cc:1034] running on GCE node
I20260812 16:42:21.787662 31681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:21.787945 31681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:21.789142 31681 hybrid_clock.cc:648] HybridClock initialized: now 1786552941789120 us; error 35 us; skew 500 ppm
I20260812 16:42:21.790396 31681 webserver.cc:460] Webserver started at http://127.21.114.126:36025/ using document root <none> and password file <none>
I20260812 16:42:21.790621 31681 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:21.790664 31681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:21.790846 31681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:21.791935 31681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "703f5bbd0f69d1c6198586c2d6ac2094"
server_key_iv: "202123af5c760b06671d258eb5828790"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.792376 31681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "703f5bbd0f69d1c6198586c2d6ac2094"
server_key_iv: "202123af5c760b06671d258eb5828790"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.793733 31681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:21.794467 31707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:21.794677 31681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:21.794768 31681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22"
format_stamp: "Formatted at 2026-08-12 16:42:21 on dist-test-slave-45dx"
server_key: "703f5bbd0f69d1c6198586c2d6ac2094"
server_key_iv: "202123af5c760b06671d258eb5828790"
server_key_version: "encryptionkey@0"
I20260812 16:42:21.794826 31681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:21.819824 31681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:21.820134 31681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:21.820247 31681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:21.824285 31681 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:41099
I20260812 16:42:21.824397 31824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:41099 every 8 connection(s)
I20260812 16:42:21.824760 31681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:21.825767 31825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:21.828071 31825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22: Bootstrap starting.
I20260812 16:42:21.828655 31825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:21.828905 31825 log.cc:824] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:21.829594 31825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22: No bootstrap required, opened a new log
I20260812 16:42:21.831125 31825 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41099 } }
I20260812 16:42:21.831333 31825 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:21.831358 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31681
I20260812 16:42:21.831390 31825 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a13d90d13c4b8eab1dc3f2142d9b22, State: Initialized, Role: FOLLOWER
I20260812 16:42:21.831504 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:21.831564 31825 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41099 } }
I20260812 16:42:21.831658 31825 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:21.831702 31825 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:21.831756 31825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:21.831755 21961 external_mini_cluster.cc:1428] Setting key 5a1571972543fbec33aface8fc860abe
I20260812 16:42:21.832527 31825 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41099 } }
I20260812 16:42:21.832641 31825 leader_election.cc:302] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4a13d90d13c4b8eab1dc3f2142d9b22; no voters:
I20260812 16:42:21.832808 31825 leader_election.cc:288] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:21.832870 31834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:21.833027 31834 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [term 1 LEADER]: Becoming Leader. State: Replica: e4a13d90d13c4b8eab1dc3f2142d9b22, State: Running, Role: LEADER
I20260812 16:42:21.833061 31825 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:21.833114 31834 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41099 } }
I20260812 16:42:21.833431 31834 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4a13d90d13c4b8eab1dc3f2142d9b22. Latest consensus state: current_term: 1 leader_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41099 } } }
I20260812 16:42:21.833509 31834 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:21.833673 31838 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a13d90d13c4b8eab1dc3f2142d9b22" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41099 } } }
I20260812 16:42:21.833803 31838 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22 [sys.catalog]: This master's current role is: LEADER
W20260812 16:42:21.834941 31873 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:21.835014 31873 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:21.835278 31848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:21.835466 31848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:21.837133 31848 catalog_manager.cc:1347] Generated new cluster ID: 475ae22c26c5480eb9c9fffe7bd8e63c
I20260812 16:42:21.837194 31848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:21.838416 31833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.832386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47332 (local address 127.21.114.126:41099)
0812 16:42:21.832601 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.832610 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.832646 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:42:21.832779 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.832788 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.832867 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.833302 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:21.833410 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:21.835102 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:21.836176 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:21.836781 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:21.836929 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:21.837688 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:21.837692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:21.837692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:21.837882 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:21.837916 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:21.837927 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:21.838007 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:21.838081 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 16:42:21.838252 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260812 16:42:21.839341 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:42:21.855489 31848 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:21.856220 31848 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:21.861595 31848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4a13d90d13c4b8eab1dc3f2142d9b22: Generated new TSK 0
I20260812 16:42:21.861856 31848 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 16:42:21.890039 31891 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 16:42:21.890196 31891 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 16:42:21.890429 31833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:21.873012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47336 (local address 127.21.114.126:41099)
0812 16:42:21.873078 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:21.873080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:21.873255 (+ 175us) server_negotiation.cc:407] Connection header received
0812 16:42:21.873372 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:21.873373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:21.873386 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:21.873456 (+ 70us) server_negotiation.cc:226] Negotiated authn=JWT
0812 16:42:21.873605 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:21.874398 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:21.875286 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:21.875594 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:21.875669 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:21.875882 (+ 213us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 16:42:21.890177 (+ 14295us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 16:42:21.890355 (+ 178us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47336: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 16:42:21.890491 31833 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47336: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 16:42:21.890980 31890 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:21.872918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:41099 (local address 127.0.0.1:47336)
0812 16:42:21.873178 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:21.873191 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:21.873257 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:21.873476 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:21.873477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:21.873479 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 16:42:21.873535 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:21.873537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:21.874495 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:21.874496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:21.875187 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:21.875189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:21.875689 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:21.875690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:21.875739 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:21.875760 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 16:42:21.890413 (+ 14653us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 16:42:21.890652 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.114.126:41099: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":118,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.21.114.126:41099: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45297/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 16:42:21.891585 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31681
2026-08-12T16:42:21Z chronyd exiting
I20260812 16:42:21.942881 21961 test_util.cc:175] -----------------------------------------------
I20260812 16:42:21.942974 21961 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786552916613187-21961-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (257 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 16:42:21.943845 21961 mini_oidc.cc:152] Starting JWKS server
I20260812 16:42:21.944675 21961 webserver.cc:460] Webserver started at https://127.0.0.1:36451/ using document root <none> and password file <none>
I20260812 16:42:21.944722 21961 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 16:42:21.944905 21961 webserver.cc:460] Webserver started at http://127.0.0.1:33155/ using document root <none> and password file <none>
2026-08-12T16:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:21Z Disabled control of system clock
I20260812 16:42:21.954521 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33293
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:36021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33293
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36451/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/testchainca.cert with env {}
W20260812 16:42:22.036949 31906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:22.037161 31906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:22.037182 31906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:22.038277 31906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:22.038311 31906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:22.038323 31906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:22.038405 31906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:22.038426 31906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 16:42:22.038450 31906 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 16:42:22.038475 31906 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36451/jwks.json
I20260812 16:42:22.039994 31906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33293
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36451/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:22.040189 31906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:22.040392 31906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:22.045344 31918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:22.045416 31916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:22.045369 31923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:22.045591 31906 server_base.cc:1034] running on GCE node
I20260812 16:42:22.045892 31906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:22.046228 31906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:22.047423 31906 hybrid_clock.cc:648] HybridClock initialized: now 1786552942047405 us; error 41 us; skew 500 ppm
I20260812 16:42:22.048915 31906 webserver.cc:460] Webserver started at http://127.21.114.126:44157/ using document root <none> and password file <none>
I20260812 16:42:22.049194 31906 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:22.049261 31906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:22.049398 31906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:22.050478 31906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "ad40012728af4346875ca11989c7f20d"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "7d797fe0a4d90ffed0abf8f157a5d91f"
server_key_iv: "cb2d25cc109439bee955b3bc0a86944b"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.050868 31906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "ad40012728af4346875ca11989c7f20d"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "7d797fe0a4d90ffed0abf8f157a5d91f"
server_key_iv: "cb2d25cc109439bee955b3bc0a86944b"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.052220 31906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:42:22.053027 31931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:22.053210 31906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:22.053323 31906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "ad40012728af4346875ca11989c7f20d"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "7d797fe0a4d90ffed0abf8f157a5d91f"
server_key_iv: "cb2d25cc109439bee955b3bc0a86944b"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.053411 31906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:22.080229 31906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:22.080718 31906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:22.080945 31906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:22.085508 31906 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33293
I20260812 16:42:22.085538 32016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33293 every 8 connection(s)
I20260812 16:42:22.085937 31906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:22.086735 32018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:22.089213 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31906
I20260812 16:42:22.089365 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:22.089591 21961 external_mini_cluster.cc:1428] Setting key 575355ca8ef325d4fa81d2db7d8ff335
I20260812 16:42:22.090286 32018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d: Bootstrap starting.
I20260812 16:42:22.090956 32018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:22.091348 32018 log.cc:824] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:22.092209 32018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d: No bootstrap required, opened a new log
I20260812 16:42:22.094691 32018 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad40012728af4346875ca11989c7f20d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33293 } }
I20260812 16:42:22.094893 32018 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:22.094939 32018 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad40012728af4346875ca11989c7f20d, State: Initialized, Role: FOLLOWER
I20260812 16:42:22.095104 32018 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad40012728af4346875ca11989c7f20d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33293 } }
I20260812 16:42:22.095193 32018 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:22.095218 32018 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:22.095309 32018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:22.096006 32018 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad40012728af4346875ca11989c7f20d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33293 } }
I20260812 16:42:22.096134 32018 leader_election.cc:302] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad40012728af4346875ca11989c7f20d; no voters:
I20260812 16:42:22.096350 32018 leader_election.cc:288] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:22.096522 32024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:22.096674 32018 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:22.096691 32024 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [term 1 LEADER]: Becoming Leader. State: Replica: ad40012728af4346875ca11989c7f20d, State: Running, Role: LEADER
I20260812 16:42:22.096921 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:22.090200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46672 (local address 127.21.114.126:33293)
0812 16:42:22.090471 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:22.090479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:22.090512 (+ 33us) server_negotiation.cc:407] Connection header received
0812 16:42:22.091015 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:22.091022 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:22.091134 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:22.091299 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:22.091607 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.093180 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.094040 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.094800 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.094948 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.095792 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:22.095797 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:22.095797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:22.096037 (+ 240us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:22.096088 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:22.096104 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:22.096182 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:22.096381 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 16:42:22.096537 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":109,"threads_started":1}
I20260812 16:42:22.096935 32024 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad40012728af4346875ca11989c7f20d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33293 } }
I20260812 16:42:22.097339 32025 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad40012728af4346875ca11989c7f20d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad40012728af4346875ca11989c7f20d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33293 } } }
I20260812 16:42:22.097499 32027 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad40012728af4346875ca11989c7f20d. Latest consensus state: current_term: 1 leader_uuid: "ad40012728af4346875ca11989c7f20d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad40012728af4346875ca11989c7f20d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33293 } } }
I20260812 16:42:22.097618 32027 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:22.097426 32025 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:22.097848 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 16:42:22.098695 32056 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:22.098917 32056 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:22.099099 32047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:22.099334 32047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:22.100875 32047 catalog_manager.cc:1347] Generated new cluster ID: 5e78ba7ff145469aac3b4be22731763f
I20260812 16:42:22.100936 32047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:22.118783 32047 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:22.119426 32047 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:22.125247 32047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad40012728af4346875ca11989c7f20d: Generated new TSK 0
I20260812 16:42:22.125443 32047 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 16:42:22.157608 32070 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 16:42:22.157765 32070 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 16:42:22.158022 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:22.135765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46674 (local address 127.21.114.126:33293)
0812 16:42:22.135845 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:22.135847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:22.135956 (+ 109us) server_negotiation.cc:407] Connection header received
0812 16:42:22.136039 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:22.136040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:22.136052 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:22.136123 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0812 16:42:22.136292 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.136817 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.137632 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.137864 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.137949 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.138129 (+ 180us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 16:42:22.157720 (+ 19591us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36451/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 16:42:22.157929 (+ 209us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46674: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36451/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 16:42:22.158088 32022 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46674: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36451/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 16:42:22.158130 32069 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:22.135710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33293 (local address 127.0.0.1:46674)
0812 16:42:22.135886 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:22.135896 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:22.135974 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:22.136139 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:22.136140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:22.136142 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 16:42:22.136203 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:22.136205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.136927 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.136929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:22.137535 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:22.137537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.137950 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.137951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:22.138011 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.138016 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 16:42:22.157900 (+ 19884us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36451/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 16:42:22.158018 (+ 118us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.114.126:33293: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36451/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260812 16:42:22.158551 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31906
2026-08-12T16:42:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (256 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 16:42:22.200098 21961 mini_oidc.cc:152] Starting JWKS server
I20260812 16:42:22.200865 21961 webserver.cc:460] Webserver started at https://127.0.0.1:36583/ using document root <none> and password file <none>
I20260812 16:42:22.200913 21961 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 16:42:22.201066 21961 webserver.cc:460] Webserver started at http://127.0.0.1:33921/ using document root <none> and password file <none>
2026-08-12T16:42:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:22Z Disabled control of system clock
I20260812 16:42:22.209951 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:41437
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:41437
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36583/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 16:42:22.295533 32076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:22.295769 32076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:22.295827 32076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:22.297029 32076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:22.297097 32076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:22.297117 32076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:22.297135 32076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:22.297166 32076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 16:42:22.297184 32076 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 16:42:22.297205 32076 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36583/jwks.json
I20260812 16:42:22.298576 32076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:41437
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:41437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36583/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:22.298867 32076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:22.299177 32076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:22.304157 32085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:22.304153 32089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:22.304225 32087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:22.304461 32076 server_base.cc:1034] running on GCE node
I20260812 16:42:22.304818 32076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:22.305159 32076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:22.306376 32076 hybrid_clock.cc:648] HybridClock initialized: now 1786552942306347 us; error 45 us; skew 500 ppm
I20260812 16:42:22.307971 32076 webserver.cc:460] Webserver started at http://127.21.114.126:38917/ using document root <none> and password file <none>
I20260812 16:42:22.308272 32076 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:22.308424 32076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:22.308615 32076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:22.309819 32076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "0159c80f3b6f48f1b83bee861094d719"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "367a4679f9e00741928012e8c3dad1e8"
server_key_iv: "7586464006641b70774dae4aaef6c697"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.310227 32076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "0159c80f3b6f48f1b83bee861094d719"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "367a4679f9e00741928012e8c3dad1e8"
server_key_iv: "7586464006641b70774dae4aaef6c697"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.311669 32076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:42:22.312518 32099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:22.312700 32076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:22.312834 32076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "0159c80f3b6f48f1b83bee861094d719"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "367a4679f9e00741928012e8c3dad1e8"
server_key_iv: "7586464006641b70774dae4aaef6c697"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.312924 32076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:22.327961 32076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:22.328390 32076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:22.328589 32076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:22.333081 32076 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:41437
I20260812 16:42:22.333113 32214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:41437 every 8 connection(s)
I20260812 16:42:22.333510 32076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:22.334244 32215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:22.334707 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32076
I20260812 16:42:22.334813 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:22.335050 21961 external_mini_cluster.cc:1428] Setting key 1c506c53d3ca2d6bb8aa38c2e9f0fbc2
I20260812 16:42:22.338227 32215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719: Bootstrap starting.
I20260812 16:42:22.338955 32215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:22.339247 32215 log.cc:824] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:22.339973 32215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719: No bootstrap required, opened a new log
I20260812 16:42:22.340996 32222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:22.335637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42108 (local address 127.21.114.126:41437)
0812 16:42:22.335842 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:22.335850 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:22.335876 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:42:22.336541 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:22.336549 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:22.336618 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:22.336738 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:22.337026 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.337897 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.338981 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.339465 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.339615 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.340340 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:22.340345 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:22.340346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:22.340518 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:22.340552 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:22.340563 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:22.340645 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:22.340726 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 16:42:22.340810 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260812 16:42:22.342053 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:42:22.342296 32215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0159c80f3b6f48f1b83bee861094d719" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41437 } }
I20260812 16:42:22.342463 32215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:22.342510 32215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0159c80f3b6f48f1b83bee861094d719, State: Initialized, Role: FOLLOWER
I20260812 16:42:22.342629 32215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0159c80f3b6f48f1b83bee861094d719" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41437 } }
I20260812 16:42:22.342731 32215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:22.342772 32215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:22.342831 32215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:22.343492 32215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0159c80f3b6f48f1b83bee861094d719" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41437 } }
I20260812 16:42:22.343582 32215 leader_election.cc:302] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0159c80f3b6f48f1b83bee861094d719; no voters:
I20260812 16:42:22.343767 32215 leader_election.cc:288] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:22.343814 32224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:22.343988 32224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [term 1 LEADER]: Becoming Leader. State: Replica: 0159c80f3b6f48f1b83bee861094d719, State: Running, Role: LEADER
I20260812 16:42:22.344004 32215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:22.344084 32224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0159c80f3b6f48f1b83bee861094d719" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41437 } }
I20260812 16:42:22.344489 32226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0159c80f3b6f48f1b83bee861094d719. Latest consensus state: current_term: 1 leader_uuid: "0159c80f3b6f48f1b83bee861094d719" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0159c80f3b6f48f1b83bee861094d719" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41437 } } }
I20260812 16:42:22.344614 32226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:22.344491 32225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0159c80f3b6f48f1b83bee861094d719" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0159c80f3b6f48f1b83bee861094d719" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 41437 } } }
I20260812 16:42:22.344749 32225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:22.344878 32240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:22.345394 32240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:22.347090 32240 catalog_manager.cc:1347] Generated new cluster ID: c1b43eaf54d447b89084e71370b64ab0
I20260812 16:42:22.347150 32240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:22.356498 32240 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:22.357205 32240 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:22.360504 32240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0159c80f3b6f48f1b83bee861094d719: Generated new TSK 0
I20260812 16:42:22.360682 32240 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:22.375267 32222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:22.371451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42110 (local address 127.21.114.126:41437)
0812 16:42:22.371506 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:22.371509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:22.371604 (+ 95us) server_negotiation.cc:407] Connection header received
0812 16:42:22.371682 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:22.371682 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:22.371694 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:22.371756 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0812 16:42:22.371927 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.372513 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.373675 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.373864 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.373914 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.374116 (+ 202us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 16:42:22.375061 (+ 945us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 16:42:22.375192 (+ 131us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42110: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":27}
W20260812 16:42:22.375329 32222 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42110: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 16:42:22.375380 32269 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:22.371349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:41437 (local address 127.0.0.1:42110)
0812 16:42:22.371525 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:22.371536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:22.371606 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:22.371779 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:22.371780 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:22.371782 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 16:42:22.371856 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:22.371858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.372599 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.372600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:22.373585 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:22.373588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.373944 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.373945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:22.374008 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.374014 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 16:42:22.375168 (+ 1154us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 16:42:22.375278 (+ 110us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.114.126:41437: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36583/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":99,"threads_started":1}
I20260812 16:42:22.375610 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32076
E20260812 16:42:22.393788 32270 webserver.cc:533] Webserver: sslize failed:
E20260812 16:42:22.393903 32270 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T16:42:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (221 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T16:42:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:22Z Disabled control of system clock
I20260812 16:42:22.430485 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36085
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:36085
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/testchainca.cert with env {}
W20260812 16:42:22.515084 32278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:22.515300 32278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:22.515322 32278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:22.516494 32278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:22.516533 32278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:22.516546 32278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:22.516558 32278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:22.516569 32278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 16:42:22.516582 32278 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 16:42:22.516592 32278 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 16:42:22.518056 32278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:36085
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:22.518250 32278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:22.518431 32278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:22.523485 32290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:22.523497 32288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:22.523486 32296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:22.523927 32278 server_base.cc:1034] running on GCE node
I20260812 16:42:22.524199 32278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:22.524526 32278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:22.525695 32278 hybrid_clock.cc:648] HybridClock initialized: now 1786552942525678 us; error 34 us; skew 500 ppm
I20260812 16:42:22.526955 32278 webserver.cc:460] Webserver started at http://127.21.114.126:38501/ using document root <none> and password file <none>
I20260812 16:42:22.527206 32278 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:22.527281 32278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:22.527437 32278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:22.528604 32278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "15f3df5a82414957a02add9f2ffbecae"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "918d46340b9027a415183d9fa235d44f"
server_key_iv: "9eefedbf39e3f4439fabc9ae2d295b29"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.528993 32278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "15f3df5a82414957a02add9f2ffbecae"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "918d46340b9027a415183d9fa235d44f"
server_key_iv: "9eefedbf39e3f4439fabc9ae2d295b29"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.530351 32278 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:22.531133 32308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:22.531330 32278 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:22.531433 32278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "15f3df5a82414957a02add9f2ffbecae"
format_stamp: "Formatted at 2026-08-12 16:42:22 on dist-test-slave-45dx"
server_key: "918d46340b9027a415183d9fa235d44f"
server_key_iv: "9eefedbf39e3f4439fabc9ae2d295b29"
server_key_version: "encryptionkey@0"
I20260812 16:42:22.531522 32278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:22.547519 32278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:22.547869 32278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:22.548032 32278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:22.552264 32278 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:36085
I20260812 16:42:22.552352 32418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:36085 every 8 connection(s)
I20260812 16:42:22.552706 32278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:22.553737 32419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:22.555272 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32278
I20260812 16:42:22.555369 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:22.555583 21961 external_mini_cluster.cc:1428] Setting key bba76c1e21ba0d8e3f3217b5881ffe65
I20260812 16:42:22.556704 32419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae: Bootstrap starting.
I20260812 16:42:22.557437 32419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:22.557736 32419 log.cc:824] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:22.558521 32419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae: No bootstrap required, opened a new log
I20260812 16:42:22.560915 32419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3df5a82414957a02add9f2ffbecae" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36085 } }
I20260812 16:42:22.561112 32419 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:22.561169 32419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f3df5a82414957a02add9f2ffbecae, State: Initialized, Role: FOLLOWER
I20260812 16:42:22.561311 32419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3df5a82414957a02add9f2ffbecae" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36085 } }
I20260812 16:42:22.561401 32419 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:22.561424 32419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:22.561440 32428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:22.556133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43184 (local address 127.21.114.126:36085)
0812 16:42:22.556400 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:22.556408 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:22.556434 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:42:22.556806 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:22.556813 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:22.556919 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:22.557036 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:22.557316 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.558331 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.559394 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.559791 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.559890 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.560688 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:22.560692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:22.560692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:22.560869 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:22.560901 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:22.560914 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:22.560963 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:22.561082 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 16:42:22.561186 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260812 16:42:22.561504 32419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:22.562282 32419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3df5a82414957a02add9f2ffbecae" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36085 } }
I20260812 16:42:22.562395 32419 leader_election.cc:302] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15f3df5a82414957a02add9f2ffbecae; no voters:
I20260812 16:42:22.562541 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:42:22.562564 32419 leader_election.cc:288] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:22.562584 32432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:22.562697 32432 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [term 1 LEADER]: Becoming Leader. State: Replica: 15f3df5a82414957a02add9f2ffbecae, State: Running, Role: LEADER
I20260812 16:42:22.562793 32432 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3df5a82414957a02add9f2ffbecae" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36085 } }
I20260812 16:42:22.562834 32419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:22.563143 32432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f3df5a82414957a02add9f2ffbecae. Latest consensus state: current_term: 1 leader_uuid: "15f3df5a82414957a02add9f2ffbecae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3df5a82414957a02add9f2ffbecae" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36085 } } }
I20260812 16:42:22.563153 32435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15f3df5a82414957a02add9f2ffbecae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3df5a82414957a02add9f2ffbecae" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36085 } } }
I20260812 16:42:22.563233 32432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:22.563261 32435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:22.563692 32448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:22.564224 32448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:22.569350 32448 catalog_manager.cc:1347] Generated new cluster ID: 3615d13fcb774660b58fca964f024470
I20260812 16:42:22.569412 32448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:22.588654 32448 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:22.589479 32448 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:22.602375 32448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15f3df5a82414957a02add9f2ffbecae: Generated new TSK 0
I20260812 16:42:22.602608 32448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:22.679883 32428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:22.613360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43192 (local address 127.21.114.126:36085)
0812 16:42:22.613404 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:22.613406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:22.613466 (+ 60us) server_negotiation.cc:407] Connection header received
0812 16:42:22.613561 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:22.613561 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:22.613572 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:22.613633 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0812 16:42:22.613831 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.614308 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.615492 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.615691 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.615753 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.615969 (+ 216us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 16:42:22.679605 (+ 63636us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 16:42:22.679817 (+ 212us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43192: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 16:42:22.679979 32428 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43192: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 16:42:22.680044 32485 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:22.613214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36085 (local address 127.0.0.1:43192)
0812 16:42:22.613400 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:22.613413 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:22.613487 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:22.613661 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:22.613662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:22.613664 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 16:42:22.613738 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:22.613740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.614411 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.614412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:22.615387 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:22.615390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:22.615791 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:22.615792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:22.615857 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:22.615864 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 16:42:22.679772 (+ 63908us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 16:42:22.679929 (+ 157us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.114.126:36085: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":105,"threads_started":1}
I20260812 16:42:22.680441 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32278
2026-08-12T16:42:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (286 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (97 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (92 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:22 dist-test-slave-45dx krb5kdc[32505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:22 dist-test-slave-45dx krb5kdc[32505](info): set up 2 sockets
Aug 12 16:42:22 dist-test-slave-45dx krb5kdc[32505](info): commencing operation
krb5kdc: starting...
W20260812 16:42:24.231949 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:24.362649 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:46647
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:46647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:24.448342 32526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:24.448559 32526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:24.448582 32526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:24.449674 32526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:24.449710 32526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:24.449724 32526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:24.449736 32526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:24.449748 32526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:24.451546 32526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:46647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:46647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:24.451766 32526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:24.451953 32526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:24.458102 32544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.458103 32542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.458103 32541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:24.458277 32526 server_base.cc:1034] running on GCE node
I20260812 16:42:24.458690 32526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:24.459031 32526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:24.460232 32526 hybrid_clock.cc:648] HybridClock initialized: now 1786552944460202 us; error 53 us; skew 500 ppm
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:24.462837 32526 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:24.463299 32526 webserver.cc:460] Webserver started at http://127.21.114.126:37867/ using document root <none> and password file <none>
I20260812 16:42:24.463538 32526 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:24.463609 32526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:24.463765 32526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:24.464915 32526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "2239a8f483b34fb294f9b92c14b95b0c"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "f9661d02fbd4f3f79a546152c4cf8ea5"
server_key_iv: "a2d25335b66a06c35fc8fc2200169f94"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.465296 32526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "2239a8f483b34fb294f9b92c14b95b0c"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "f9661d02fbd4f3f79a546152c4cf8ea5"
server_key_iv: "a2d25335b66a06c35fc8fc2200169f94"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.466748 32526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:24.467638 32559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.467912 32526 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:24.468027 32526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "2239a8f483b34fb294f9b92c14b95b0c"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "f9661d02fbd4f3f79a546152c4cf8ea5"
server_key_iv: "a2d25335b66a06c35fc8fc2200169f94"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.468118 32526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:24.480769 32526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:24.482811 32526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:24.482985 32526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:24.487370 32526 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:46647
I20260812 16:42:24.487413 32652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:46647 every 8 connection(s)
I20260812 16:42:24.487784 32526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:24.488768 32654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:24.491127 32654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c: Bootstrap starting.
I20260812 16:42:24.491746 32654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:24.492074 32654 log.cc:824] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:24.492877 32654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c: No bootstrap required, opened a new log
I20260812 16:42:24.494563 32654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2239a8f483b34fb294f9b92c14b95b0c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46647 } }
I20260812 16:42:24.494707 32654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:24.494731 32654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2239a8f483b34fb294f9b92c14b95b0c, State: Initialized, Role: FOLLOWER
I20260812 16:42:24.494937 32654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2239a8f483b34fb294f9b92c14b95b0c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46647 } }
I20260812 16:42:24.495024 32654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:24.495066 32654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:24.495122 32654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:24.495700 32654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2239a8f483b34fb294f9b92c14b95b0c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46647 } }
I20260812 16:42:24.495821 32654 leader_election.cc:302] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2239a8f483b34fb294f9b92c14b95b0c; no voters:
I20260812 16:42:24.496025 32654 leader_election.cc:288] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:24.496116 32659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:24.496335 32654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:24.496532 32659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [term 1 LEADER]: Becoming Leader. State: Replica: 2239a8f483b34fb294f9b92c14b95b0c, State: Running, Role: LEADER
I20260812 16:42:24.496690 32659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2239a8f483b34fb294f9b92c14b95b0c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46647 } }
I20260812 16:42:24.497267 32662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2239a8f483b34fb294f9b92c14b95b0c. Latest consensus state: current_term: 1 leader_uuid: "2239a8f483b34fb294f9b92c14b95b0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2239a8f483b34fb294f9b92c14b95b0c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46647 } } }
I20260812 16:42:24.497373 32662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:24.497442 32661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2239a8f483b34fb294f9b92c14b95b0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2239a8f483b34fb294f9b92c14b95b0c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46647 } } }
I20260812 16:42:24.497507 32661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:24.497768 32671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:24.497840 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32526
I20260812 16:42:24.497960 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:24.498183 21961 external_mini_cluster.cc:1428] Setting key d34c3728d1fed9ddb07e4b78eee5a48f
I20260812 16:42:24.498363 32671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:24.500058 32671 catalog_manager.cc:1347] Generated new cluster ID: 8dc213fd5600470ab989bee3d2f4c54f
I20260812 16:42:24.500113 32671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:24.519272 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:24.498685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38766 (local address 127.21.114.126:46647)
0812 16:42:24.498905 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:24.498915 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:24.499354 (+ 439us) server_negotiation.cc:407] Connection header received
0812 16:42:24.499518 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:24.499523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:24.499584 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:24.499727 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:24.508994 (+ 9267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.510521 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.511577 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.512253 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.512425 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:24.515294 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:24.515300 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:24.515300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:24.515315 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:24.517374 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:24.517798 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:24.517801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:24.517802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:24.517928 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:24.518146 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:24.518147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:24.518147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:24.518450 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:24.518605 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:24.518721 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 16:42:24.518853 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":116,"threads_started":1}
I20260812 16:42:24.520859 32671 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:24.521566 32671 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:24.534534 32671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2239a8f483b34fb294f9b92c14b95b0c: Generated new TSK 0
I20260812 16:42:24.534747 32671 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:24.565352 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46647
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:24.649654 32703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:24.649873 32703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:24.649895 32703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:24.651109 32703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:24.651152 32703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:24.651178 32703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:24.653031 32703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:24.653304 32703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:24.653594 32703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:24.659809 32714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.659880 32711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.659825 32719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:24.660022 32703 server_base.cc:1034] running on GCE node
I20260812 16:42:24.660276 32703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:24.660562 32703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:24.661742 32703 hybrid_clock.cc:648] HybridClock initialized: now 1786552944661731 us; error 28 us; skew 500 ppm
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:24.664556 32703 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:24.665043 32703 webserver.cc:460] Webserver started at http://127.21.114.65:36291/ using document root <none> and password file <none>
I20260812 16:42:24.665292 32703 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:24.665359 32703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:24.665513 32703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:24.666561 32703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "c27fee5c2f114c308da8a51618c404cc"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "c1e1eeddad07484ac211a2488d22f848"
server_key_iv: "44bb86ddd5e5396de563bd6b18f205b6"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.666944 32703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "c27fee5c2f114c308da8a51618c404cc"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "c1e1eeddad07484ac211a2488d22f848"
server_key_iv: "44bb86ddd5e5396de563bd6b18f205b6"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.668291 32703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:24.669098 32730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.669279 32703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:24.669384 32703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "c27fee5c2f114c308da8a51618c404cc"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "c1e1eeddad07484ac211a2488d22f848"
server_key_iv: "44bb86ddd5e5396de563bd6b18f205b6"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.669467 32703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:24.687273 32703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:24.689566 32703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:24.689741 32703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:24.689993 32703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:24.690308 32703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:24.690366 32703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.690409 32703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:24.690452 32703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.696676 32703 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:44321
I20260812 16:42:24.696728 486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:44321 every 8 connection(s)
I20260812 16:42:24.697060 32703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:24.701072 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32703
I20260812 16:42:24.701202 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:24.701399 21961 external_mini_cluster.cc:1428] Setting key ebcbc4f7872d6260e83b8862a708d262
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:24.708149 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:24.698032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:42017 (local address 127.21.114.126:46647)
0812 16:42:24.698135 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:24.698138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:24.698439 (+ 301us) server_negotiation.cc:407] Connection header received
0812 16:42:24.699404 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:24.699405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:24.699417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:24.699475 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:24.700120 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.700756 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.702105 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.702365 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.702448 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:24.704880 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:24.704882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:24.704883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:24.704892 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:24.706609 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:24.707101 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:24.707102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:24.707103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:24.707171 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:24.707458 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:24.707459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:24.707459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:24.707586 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:24.707661 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:24.707957 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 16:42:24.708056 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 16:42:24.708389 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:24.698013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46647 (local address 127.21.114.65:42017)
0812 16:42:24.698283 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:24.698333 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:24.699289 (+ 956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:24.699531 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:24.699534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:24.699790 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:24.700000 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:24.700004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.700874 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.700875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:24.701989 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:24.701992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.702466 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.702467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:24.702619 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:24.703216 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:24.703225 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:24.704757 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:24.706701 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:24.706707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:24.706709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:24.706965 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:24.707246 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:24.707247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:24.707247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:24.707370 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:24.707663 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:24.707671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:24.707816 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 16:42:24.707931 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 16:42:24.708093 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":133,"threads_started":1}
I20260812 16:42:24.708904 488 heartbeater.cc:347] Connected to a master server at 127.21.114.126:46647
I20260812 16:42:24.709002 488 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:24.709206 488 heartbeater.cc:511] Master 127.21.114.126:46647 requested a full tablet report, sending...
I20260812 16:42:24.709762 32590 ts_manager.cc:194] Registered new tserver with Master: c27fee5c2f114c308da8a51618c404cc (127.21.114.65:44321)
I20260812 16:42:24.710372 32590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:42017
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:24.730648 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46647
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:24.814424 499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:24.814623 499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:24.814646 499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:24.815811 499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:24.815856 499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:24.815882 499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:24.817399 499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:24.817585 499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:24.817760 499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:24.823091 511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.823096 506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.823086 509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:24.823123 499 server_base.cc:1034] running on GCE node
I20260812 16:42:24.823506 499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:24.823774 499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:24.824950 499 hybrid_clock.cc:648] HybridClock initialized: now 1786552944824932 us; error 30 us; skew 500 ppm
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:24.827523 499 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:24.828017 499 webserver.cc:460] Webserver started at http://127.21.114.66:40369/ using document root <none> and password file <none>
I20260812 16:42:24.828274 499 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:24.828405 499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:24.828565 499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:24.829636 499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "f215d618c51b41a781e1199bd7c71fe8"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "c21960e5725b6ab4858263f2af7b4f82"
server_key_iv: "aa7743b84adb1dc467cb000e504b114a"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.830024 499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "f215d618c51b41a781e1199bd7c71fe8"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "c21960e5725b6ab4858263f2af7b4f82"
server_key_iv: "aa7743b84adb1dc467cb000e504b114a"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.831502 499 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:24.832278 525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.832548 499 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:24.832647 499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "f215d618c51b41a781e1199bd7c71fe8"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "c21960e5725b6ab4858263f2af7b4f82"
server_key_iv: "aa7743b84adb1dc467cb000e504b114a"
server_key_version: "encryptionkey@0"
I20260812 16:42:24.832746 499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:24.864526 499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:24.866539 499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:24.866725 499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:24.867008 499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:24.867358 499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:24.867419 499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.867457 499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:24.867508 499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:24.874286 499 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:43103
I20260812 16:42:24.874349 743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:43103 every 8 connection(s)
I20260812 16:42:24.874662 499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:24.876518 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 499
I20260812 16:42:24.876626 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:24.876842 21961 external_mini_cluster.cc:1428] Setting key e8334acf5871409eafa849d8855165a8
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:24.884927 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:24.875481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:47353 (local address 127.21.114.126:46647)
0812 16:42:24.875554 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:24.875555 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:24.875776 (+ 221us) server_negotiation.cc:407] Connection header received
0812 16:42:24.876914 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:24.876916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:24.876931 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:24.876984 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:24.877625 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.878135 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.879164 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.879366 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.879457 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:24.881880 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:24.881882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:24.881882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:24.881891 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:24.883396 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:24.883839 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:24.883840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:24.883841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:24.883909 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:24.884186 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:24.884187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:24.884187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:24.884366 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:24.884455 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:24.884738 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 16:42:24.884830 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:42:24.885152 749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:24.875462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46647 (local address 127.21.114.66:47353)
0812 16:42:24.875647 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:24.875692 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:24.876789 (+ 1097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:24.877057 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:24.877062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:24.877329 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:24.877526 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:24.877530 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.878239 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.878240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:24.879068 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:24.879070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:24.879470 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:24.879471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:24.879602 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:24.880139 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:24.880147 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:24.881751 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:24.883506 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:24.883514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:24.883516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:24.883753 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:24.883984 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:24.883985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:24.883985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:24.884105 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:24.884443 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:24.884450 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:24.884596 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 16:42:24.884716 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 16:42:24.884891 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260812 16:42:24.885623 744 heartbeater.cc:347] Connected to a master server at 127.21.114.126:46647
I20260812 16:42:24.885739 744 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:24.885928 744 heartbeater.cc:511] Master 127.21.114.126:46647 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
I20260812 16:42:24.886349 32590 ts_manager.cc:194] Registered new tserver with Master: f215d618c51b41a781e1199bd7c71fe8 (127.21.114.66:43103)
I20260812 16:42:24.886737 32590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:47353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:24.903084 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46647
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:39589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:24.985826 752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:24.986029 752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:24.986052 752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:24.987146 752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:24.987179 752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:24.987205 752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:24.988639 752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:39589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:24.988822 752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:24.988997 752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:24.994127 765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.994143 762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:24.994131 768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:24.994318 752 server_base.cc:1034] running on GCE node
I20260812 16:42:24.994587 752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:24.994835 752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:24.996057 752 hybrid_clock.cc:648] HybridClock initialized: now 1786552944996041 us; error 28 us; skew 500 ppm
Aug 12 16:42:24 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:24.999073 752 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:24.999504 752 webserver.cc:460] Webserver started at http://127.21.114.67:46389/ using document root <none> and password file <none>
I20260812 16:42:24.999759 752 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:24.999835 752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:24.999998 752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:25.001129 752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "b23ce43fca9f461b9eeff4482ec57896"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "a79c3268ae8c85671db910a579456878"
server_key_iv: "094417ad7875bdcc5176eabe63c89345"
server_key_version: "encryptionkey@0"
I20260812 16:42:25.001504 752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "b23ce43fca9f461b9eeff4482ec57896"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "a79c3268ae8c85671db910a579456878"
server_key_iv: "094417ad7875bdcc5176eabe63c89345"
server_key_version: "encryptionkey@0"
I20260812 16:42:25.002918 752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:42:25.003724 778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:25.003962 752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:25.004079 752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "b23ce43fca9f461b9eeff4482ec57896"
format_stamp: "Formatted at 2026-08-12 16:42:24 on dist-test-slave-45dx"
server_key: "a79c3268ae8c85671db910a579456878"
server_key_iv: "094417ad7875bdcc5176eabe63c89345"
server_key_version: "encryptionkey@0"
I20260812 16:42:25.004158 752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:25.015448 752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:25.017529 752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:25.017695 752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:25.017930 752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:25.018245 752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:25.018306 752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:25.018347 752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:25.018378 752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:25.024524 752 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:41825
I20260812 16:42:25.024583 980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:41825 every 8 connection(s)
I20260812 16:42:25.024935 752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:25.027994 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 752
I20260812 16:42:25.028123 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:25.028373 21961 external_mini_cluster.cc:1428] Setting key 8db6184284a6af4d37933a8f536f4252
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552944, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:25.034549 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:25.025659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:46815 (local address 127.21.114.126:46647)
0812 16:42:25.025703 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.025705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.025927 (+ 222us) server_negotiation.cc:407] Connection header received
0812 16:42:25.026818 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.026819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.026829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.026895 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.027481 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.027972 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.029533 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.029726 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.029782 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:25.031955 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:25.031957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:25.031957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:25.031964 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:25.033247 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.033615 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.033616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.033616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.033684 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.033959 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.033960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.033960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.034060 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:25.034110 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:25.034401 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 16:42:25.034481 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:42:25.034788 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:25.025601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46647 (local address 127.21.114.67:46815)
0812 16:42:25.025793 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:25.025834 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:25.026724 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:25.026974 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:25.026978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:25.027216 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:25.027407 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:25.027411 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.028073 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.028074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:25.029454 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:25.029458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.029802 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.029803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:25.029908 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:25.030447 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:25.030461 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:25.031867 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:25.033323 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:25.033329 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:25.033330 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:25.033544 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:25.033774 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:25.033775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:25.033775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:25.033890 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:25.034125 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:25.034130 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:25.034252 (+ 122us) client_negotiation.cc:769] Sending connection context
0812 16:42:25.034339 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 16:42:25.034507 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260812 16:42:25.035288 981 heartbeater.cc:347] Connected to a master server at 127.21.114.126:46647
I20260812 16:42:25.035374 981 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:25.035581 981 heartbeater.cc:511] Master 127.21.114.126:46647 requested a full tablet report, sending...
I20260812 16:42:25.035962 32590 ts_manager.cc:194] Registered new tserver with Master: b23ce43fca9f461b9eeff4482ec57896 (127.21.114.67:41825)
I20260812 16:42:25.036402 32590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:46815
I20260812 16:42:25.040191 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/test-admin.keytab.
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.057885 21961 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 16:42:25.059629 995 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:25.058846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.21.114.65:44321)
0812 16:42:25.059037 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.059042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.059052 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:25.059079 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.059081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.059095 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.059165 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.059544 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57704: BlockingRecv error: recv got EOF from 127.0.0.1:57704 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
W20260812 16:42:25.059839 21961 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc' of type FILE
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.061033 21961 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.061952 21961 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:25.069620 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:25.062515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57708 (local address 127.21.114.65:44321)
0812 16:42:25.062571 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.062573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.062598 (+ 25us) server_negotiation.cc:407] Connection header received
0812 16:42:25.062653 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.062654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.062664 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.062709 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.063055 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.063777 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.064585 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.064907 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.065004 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:25.067055 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:25.067063 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:25.067064 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:25.067070 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:25.068561 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.068871 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.068874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.068874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.068930 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.069098 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.069098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.069099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.069226 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:25.069327 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:25.069395 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 16:42:25.069457 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260812 16:42:25.071359 995 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:25.070873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57716 (local address 127.21.114.65:44321)
0812 16:42:25.070908 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.070910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.070945 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:42:25.070995 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.070995 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.071003 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.071050 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.071308 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57716: BlockingRecv error: recv got EOF from 127.0.0.1:57716 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 16:42:25.071512 21961 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc)
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.072657 21961 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.073537 21961 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:25.080374 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:25.074059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57726 (local address 127.21.114.65:44321)
0812 16:42:25.074118 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.074119 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.074145 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:42:25.074195 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.074196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.074204 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.074251 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.074644 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.075127 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.075821 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.076030 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.076087 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:25.078154 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:25.078155 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:25.078155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:25.078161 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:25.079342 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.079647 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.079648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.079649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.079700 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.079884 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.079885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.079885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.079968 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:25.080037 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:25.080139 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 16:42:25.080197 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 16:42:25.082149 995 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:25.081404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57728 (local address 127.21.114.65:44321)
0812 16:42:25.081470 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.081473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.081539 (+ 66us) server_negotiation.cc:407] Connection header received
0812 16:42:25.081625 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.081626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.081635 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.081692 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.082103 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57728: BlockingRecv error: recv got EOF from 127.0.0.1:57728 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 16:42:25.082242 21961 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786552916613187-21961-0/krb5kdc/krb5cc' of type FILE
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.083153 21961 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:25.084121 21961 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[32505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:42:25.091430 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:25.084683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57734 (local address 127.21.114.65:44321)
0812 16:42:25.084742 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:25.084744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:25.084791 (+ 47us) server_negotiation.cc:407] Connection header received
0812 16:42:25.084884 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:25.084885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:25.084894 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:25.084949 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:25.085325 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.085783 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.086458 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:25.086652 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:25.086734 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:25.088871 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:25.088873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:25.088873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:25.088880 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:25.090313 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.090660 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.090662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.090662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.090720 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:25.090941 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:25.090942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:25.090943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:25.091048 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:25.091152 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:25.091257 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 16:42:25.091334 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:42:25.092190 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32703
I20260812 16:42:25.106070 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 499
I20260812 16:42:25.136144 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 752
I20260812 16:42:25.146026 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32526
2026-08-12T16:42:25Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2277 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[1019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[1019](info): set up 2 sockets
Aug 12 16:42:25 dist-test-slave-45dx krb5kdc[1019](info): commencing operation
krb5kdc: starting...
W20260812 16:42:26.454717 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:26 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:26Z Disabled control of system clock
WARNING: no policy specified for oryx/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab.
Entry for principal oryx/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab.
I20260812 16:42:26.579886 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35983
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab
--principal=oryx/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:26.671571 1047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:26.671789 1047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:26.671813 1047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:26.673940 1047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:26.673990 1047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:26.674026 1047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:26.674059 1047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:26.674093 1047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:26.676429 1047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab
--principal=oryx/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:26.676762 1047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:26.677047 1047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:26.683499 1055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:26.683477 1053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:26.683467 1052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:26.685416 1047 server_base.cc:1034] running on GCE node
I20260812 16:42:26.685729 1047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:26.686105 1047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:26.687291 1047 hybrid_clock.cc:648] HybridClock initialized: now 1786552946687249 us; error 45 us; skew 500 ppm
Aug 12 16:42:26 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:26.690790 1047 init.cc:377] Logged in from keytab as oryx/127.21.114.126@KRBTEST.COM (short username oryx)
I20260812 16:42:26.691430 1047 webserver.cc:460] Webserver started at http://127.21.114.126:46603/ using document root <none> and password file <none>
I20260812 16:42:26.691779 1047 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:26.691872 1047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:26.692034 1047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:26.693876 1047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "040f6bc8c526460195968f7952f6fe48"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "ebf4723043a7a48570483cab5ceb5b89"
server_key_iv: "934652c2268a88d931a59e288d3c8c8a"
server_key_version: "encryptionkey@0"
I20260812 16:42:26.694404 1047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "040f6bc8c526460195968f7952f6fe48"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "ebf4723043a7a48570483cab5ceb5b89"
server_key_iv: "934652c2268a88d931a59e288d3c8c8a"
server_key_version: "encryptionkey@0"
I20260812 16:42:26.696662 1047 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 16:42:26.697589 1066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:26.697852 1047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:26.697952 1047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "040f6bc8c526460195968f7952f6fe48"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "ebf4723043a7a48570483cab5ceb5b89"
server_key_iv: "934652c2268a88d931a59e288d3c8c8a"
server_key_version: "encryptionkey@0"
I20260812 16:42:26.698040 1047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:26.723559 1047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:26.726171 1047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:26.726302 1047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:26.730580 1047 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:35983
I20260812 16:42:26.730621 1168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:35983 every 8 connection(s)
I20260812 16:42:26.731045 1047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:26.732121 1169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:26.734526 1169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Bootstrap starting.
I20260812 16:42:26.735140 1169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:26.735430 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 1047
I20260812 16:42:26.735467 1169 log.cc:824] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:26.735563 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:26.735759 21961 external_mini_cluster.cc:1428] Setting key c1de581a698d8eaf5a62168176c171a3
I20260812 16:42:26.736270 1169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: No bootstrap required, opened a new log
I20260812 16:42:26.738042 1169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } }
I20260812 16:42:26.738216 1169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:26.738263 1169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 040f6bc8c526460195968f7952f6fe48, State: Initialized, Role: FOLLOWER
I20260812 16:42:26.738399 1169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } }
I20260812 16:42:26.738508 1169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:26.738556 1169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:26.738636 1169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:26.739534 1169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } }
I20260812 16:42:26.739665 1169 leader_election.cc:302] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 040f6bc8c526460195968f7952f6fe48; no voters:
I20260812 16:42:26.739883 1169 leader_election.cc:288] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:26.739909 1179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:26.740031 1179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 LEADER]: Becoming Leader. State: Replica: 040f6bc8c526460195968f7952f6fe48, State: Running, Role: LEADER
I20260812 16:42:26.740118 1179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } }
I20260812 16:42:26.740175 1169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:26.740458 1179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 040f6bc8c526460195968f7952f6fe48. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } }
I20260812 16:42:26.740540 1179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:26.740473 1183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } }
I20260812 16:42:26.740577 1183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:26.740815 1191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:26.742592 1191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 16:42:26 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:26.748425 1191 catalog_manager.cc:1347] Generated new cluster ID: 88c1d85c70264f50a1b00c579dd84733
I20260812 16:42:26.748483 1191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:26.748799 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:26.736391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34648 (local address 127.21.114.126:35983)
0812 16:42:26.736653 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:26.736663 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:26.736697 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:42:26.738059 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:26.738068 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:26.738126 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:26.738310 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:26.739069 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:26.740219 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:26.741328 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:26.741999 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:26.742111 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:26.744949 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:26.744952 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:26.744953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:26.744964 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:26.746872 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:26.747357 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:26.747360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:26.747361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:26.747466 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:26.747717 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:26.747718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:26.747718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:26.748022 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:26.748214 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:26.748284 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 16:42:26.748619 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":91,"threads_started":1}
I20260812 16:42:26.769021 1191 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:26.769569 1191 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:26.774281 1191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Generated new TSK 0
I20260812 16:42:26.774469 1191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab.
Entry for principal oryx/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab.
I20260812 16:42:26.802819 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35983
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:26.887120 1221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:26.887329 1221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:26.887353 1221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:26.888597 1221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:26.888641 1221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:26.888692 1221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:26.890174 1221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:26.890432 1221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:26.890674 1221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:26.895893 1235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:26.895902 1236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:26.896019 1221 server_base.cc:1034] running on GCE node
W20260812 16:42:26.896108 1238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:26.896449 1221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:26.896665 1221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:26.897858 1221 hybrid_clock.cc:648] HybridClock initialized: now 1786552946897836 us; error 37 us; skew 500 ppm
Aug 12 16:42:26 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:26.900538 1221 init.cc:377] Logged in from keytab as oryx/127.21.114.65@KRBTEST.COM (short username oryx)
I20260812 16:42:26.900982 1221 webserver.cc:460] Webserver started at http://127.21.114.65:34675/ using document root <none> and password file <none>
I20260812 16:42:26.901213 1221 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:26.901259 1221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:26.901427 1221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:26.902498 1221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "542efa7b07bd4248aad75cc8491cb7d6"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "4374000ca4b0d3e1a8efcfee1c6e945f"
server_key_iv: "0ca21d32942785c7601955817494a54f"
server_key_version: "encryptionkey@0"
I20260812 16:42:26.902956 1221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "542efa7b07bd4248aad75cc8491cb7d6"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "4374000ca4b0d3e1a8efcfee1c6e945f"
server_key_iv: "0ca21d32942785c7601955817494a54f"
server_key_version: "encryptionkey@0"
I20260812 16:42:26.904385 1221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260812 16:42:26.905179 1248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:26.905368 1221 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:26.905458 1221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "542efa7b07bd4248aad75cc8491cb7d6"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "4374000ca4b0d3e1a8efcfee1c6e945f"
server_key_iv: "0ca21d32942785c7601955817494a54f"
server_key_version: "encryptionkey@0"
I20260812 16:42:26.905515 1221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:26.918833 1221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:26.921404 1221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:26.921525 1221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:26.921715 1221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:26.922084 1221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:26.922122 1221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:26.922147 1221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:26.922191 1221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:26.928071 1221 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:40657
I20260812 16:42:26.928146 1475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:40657 every 8 connection(s)
I20260812 16:42:26.928524 1221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
Aug 12 16:42:26 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:26.938638 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 1221
I20260812 16:42:26.938781 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:26.938990 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:26.929326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53301 (local address 127.21.114.126:35983)
0812 16:42:26.929423 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:26.929426 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:26.929643 (+ 217us) server_negotiation.cc:407] Connection header received
0812 16:42:26.930261 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:26.930262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:26.930280 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:26.930336 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:26.931439 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:26.932021 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:26.933186 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:26.933441 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:26.933548 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:26.935880 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:26.935881 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:26.935882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:26.935895 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:26.937308 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:26.937778 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:26.937779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:26.937780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:26.937849 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:26.938151 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:26.938152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:26.938152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:26.938288 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:26.938380 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:26.938780 (+ 400us) server_negotiation.cc:299] Negotiation successful
0812 16:42:26.938923 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 16:42:26.939042 21961 external_mini_cluster.cc:1428] Setting key 695e2a268e9af9cb82c5e5c43644be75
I20260812 16:42:26.939180 1481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:26.929277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:53301)
0812 16:42:26.929495 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:26.929542 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:26.930132 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:26.930411 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:26.930416 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:26.931095 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:26.931315 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:26.931320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:26.932137 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:26.932138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:26.933071 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:26.933074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:26.933581 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:26.933583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:26.933722 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:26.934197 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:26.934207 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:26.935738 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:26.937420 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:26.937428 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:26.937431 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:26.937678 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:26.937936 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:26.937937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:26.937937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:26.938060 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:26.938369 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:26.938377 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:26.938566 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 16:42:26.938710 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 16:42:26.938916 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":107,"threads_started":1}
I20260812 16:42:26.939708 1478 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35983
I20260812 16:42:26.939821 1478 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:26.940043 1478 heartbeater.cc:511] Master 127.21.114.126:35983 requested a full tablet report, sending...
I20260812 16:42:26.940722 1097 ts_manager.cc:194] Registered new tserver with Master: 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65:40657)
I20260812 16:42:26.941778 1097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:53301
WARNING: no policy specified for oryx/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab.
Entry for principal oryx/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab.
I20260812 16:42:26.966629 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35983
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:27.056496 1486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:27.056749 1486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:27.056790 1486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:27.057931 1486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:27.058008 1486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:27.058054 1486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:27.059540 1486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:27.059836 1486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:27.060105 1486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.065541 1494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.065654 1486 server_base.cc:1034] running on GCE node
W20260812 16:42:27.065786 1503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.065951 1498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.066241 1486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.066476 1486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.067644 1486 hybrid_clock.cc:648] HybridClock initialized: now 1786552947067625 us; error 26 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.070580 1486 init.cc:377] Logged in from keytab as oryx/127.21.114.66@KRBTEST.COM (short username oryx)
I20260812 16:42:27.071132 1486 webserver.cc:460] Webserver started at http://127.21.114.66:46633/ using document root <none> and password file <none>
I20260812 16:42:27.071424 1486 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.071477 1486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.071679 1486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:27.072933 1486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "82ec7562b78e422fb9d9abd83afe052c"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "a92fba338f4ff2ad3f8e3fff4f9c2a94"
server_key_iv: "d722f1d93a4f54ad172dc60effff7ade"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.073338 1486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "82ec7562b78e422fb9d9abd83afe052c"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "a92fba338f4ff2ad3f8e3fff4f9c2a94"
server_key_iv: "d722f1d93a4f54ad172dc60effff7ade"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.074946 1486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:27.075875 1517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.076071 1486 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:27.076197 1486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "82ec7562b78e422fb9d9abd83afe052c"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "a92fba338f4ff2ad3f8e3fff4f9c2a94"
server_key_iv: "d722f1d93a4f54ad172dc60effff7ade"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.076305 1486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.090700 1486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.092916 1486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:27.093092 1486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.093348 1486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:27.093683 1486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:27.093743 1486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.093780 1486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:27.093811 1486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.100198 1486 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:44513
I20260812 16:42:27.100251 1723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:44513 every 8 connection(s)
I20260812 16:42:27.100625 1486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:27.102296 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 1486
I20260812 16:42:27.102413 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:27.102649 21961 external_mini_cluster.cc:1428] Setting key 83059019a565d88715a415d565b600be
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:27.112141 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.101466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:60699 (local address 127.21.114.126:35983)
0812 16:42:27.101512 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.101514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.101802 (+ 288us) server_negotiation.cc:407] Connection header received
0812 16:42:27.102612 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.102614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.102626 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.102710 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.104096 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.104688 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.105935 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.106139 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.106219 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.108791 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.108793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.108793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.108803 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.110626 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.111080 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.111082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.111082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.111154 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.111417 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.111418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.111419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.111579 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.111659 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.111934 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.112032 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:42:27.112180 1729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.101443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.66:60699)
0812 16:42:27.101662 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.101699 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.102463 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.102778 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.102783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.103664 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.103963 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.103970 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.104790 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.104791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.105821 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.105824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.106246 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.106247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.106398 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.106934 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.106945 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.108686 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.110722 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.110729 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.110731 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.110991 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.111230 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.111230 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.111231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.111343 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.111652 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.111656 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.111771 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.111879 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.112008 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":112,"threads_started":1}
I20260812 16:42:27.112795 1724 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35983
I20260812 16:42:27.112938 1724 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:27.113137 1724 heartbeater.cc:511] Master 127.21.114.126:35983 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.21.114.67@KRBTEST.COM; defaulting to no policy
I20260812 16:42:27.113570 1097 ts_manager.cc:194] Registered new tserver with Master: 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513)
I20260812 16:42:27.114019 1097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:60699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab.
Entry for principal oryx/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab.
I20260812 16:42:27.131951 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35983
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:27.216578 1733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:27.216801 1733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:27.216825 1733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:27.217953 1733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:27.217990 1733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:27.218015 1733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:27.219391 1733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:27.219578 1733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:27.219761 1733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.225581 1739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.225581 1743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.225616 1740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.226089 1733 server_base.cc:1034] running on GCE node
I20260812 16:42:27.226402 1733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.226693 1733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.227946 1733 hybrid_clock.cc:648] HybridClock initialized: now 1786552947227934 us; error 30 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.230856 1733 init.cc:377] Logged in from keytab as oryx/127.21.114.67@KRBTEST.COM (short username oryx)
I20260812 16:42:27.231240 1733 webserver.cc:460] Webserver started at http://127.21.114.67:37691/ using document root <none> and password file <none>
I20260812 16:42:27.231448 1733 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.231488 1733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.231580 1733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:27.232697 1733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "d886e8895c0af55807223cb650950bb9"
server_key_iv: "534ca43a3ea45c4f3f915ab1211599d0"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.233026 1733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "d886e8895c0af55807223cb650950bb9"
server_key_iv: "534ca43a3ea45c4f3f915ab1211599d0"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.234320 1733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:27.235071 1755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.235275 1733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:27.235345 1733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "d886e8895c0af55807223cb650950bb9"
server_key_iv: "534ca43a3ea45c4f3f915ab1211599d0"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.235443 1733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.243638 1733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.245486 1733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:27.245651 1733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.245885 1733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:27.246189 1733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:27.246224 1733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.246248 1733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:27.246299 1733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.252202 1733 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:40441
I20260812 16:42:27.252278 1984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:40441 every 8 connection(s)
I20260812 16:42:27.252647 1733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:27.257166 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 1733
I20260812 16:42:27.257248 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:27.257457 21961 external_mini_cluster.cc:1428] Setting key f2acc2a37620df722d08169c7abf2193
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:27.262485 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.253546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:57479 (local address 127.21.114.126:35983)
0812 16:42:27.253622 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.253628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.253730 (+ 102us) server_negotiation.cc:407] Connection header received
0812 16:42:27.254217 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.254218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.254229 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.254280 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.255168 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.255660 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.256686 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.256868 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.256923 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.259373 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.259374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.259375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.259381 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.260815 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.261272 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.261273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.261273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.261329 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.261574 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.261576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.261577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.261784 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.261866 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.262274 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.262365 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 16:42:27.262712 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.253385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:57479)
0812 16:42:27.253602 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.253650 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.254133 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.254339 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.254342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.254902 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.255088 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.255093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.255746 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.255747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.256612 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.256614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.256967 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.256968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.257079 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.257688 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.257699 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.259281 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.260889 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.260895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.260897 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.261212 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.261394 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.261395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.261395 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.261494 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.261879 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.261886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.262058 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.262231 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.262441 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":84,"threads_started":1}
I20260812 16:42:27.263294 1985 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35983
I20260812 16:42:27.263391 1985 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:27.263525 1985 heartbeater.cc:511] Master 127.21.114.126:35983 requested a full tablet report, sending...
I20260812 16:42:27.263934 1097 ts_manager.cc:194] Registered new tserver with Master: 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441)
I20260812 16:42:27.264261 1097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:57479
I20260812 16:42:27.269315 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.21.114.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.125.keytab.
Entry for principal oryx/127.21.114.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.125.keytab.
I20260812 16:42:27.299077 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:43639
--webserver_interface=127.21.114.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.125.keytab
--principal=oryx/127.21.114.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35983,127.21.114.125:43639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:27.382731 1995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:27.382970 1995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:27.383009 1995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:27.384119 1995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:27.384191 1995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:27.384217 1995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:27.384238 1995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:27.384267 1995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:27.385774 1995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35983,127.21.114.125:43639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.125.keytab
--principal=oryx/127.21.114.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:43639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.114.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
W20260812 16:42:27.385933 1995 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.21.114.126:35983,127.21.114.125:43639'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 16:42:27.386099 1995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:27.386336 1995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.391307 2004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.391325 2007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.391326 2003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.391345 1995 server_base.cc:1034] running on GCE node
I20260812 16:42:27.391763 1995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.392060 1995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.393229 1995 hybrid_clock.cc:648] HybridClock initialized: now 1786552947393225 us; error 37 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.395931 1995 init.cc:377] Logged in from keytab as oryx/127.21.114.125@KRBTEST.COM (short username oryx)
I20260812 16:42:27.396433 1995 webserver.cc:460] Webserver started at http://127.21.114.125:46851/ using document root <none> and password file <none>
I20260812 16:42:27.396673 1995 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.396744 1995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.396906 1995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:27.397924 1995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/instance:
uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "576a210a77c89394aa272cbc66face46"
server_key_iv: "2d2e437dce2eaaf0349f90784c2a6cad"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.398285 1995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal/instance:
uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "576a210a77c89394aa272cbc66face46"
server_key_iv: "2d2e437dce2eaaf0349f90784c2a6cad"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.399602 1995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:27.400488 2023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.400693 1995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:27.400796 1995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "576a210a77c89394aa272cbc66face46"
server_key_iv: "2d2e437dce2eaaf0349f90784c2a6cad"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.400885 1995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.408396 1995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.410753 1995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:27.410919 1995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.414922 1995 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.125:43639
I20260812 16:42:27.414970 2128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.125:43639 every 8 connection(s)
I20260812 16:42:27.415313 1995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
I20260812 16:42:27.416416 2129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:27.417940 2129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.125@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:27.424093 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 1995
I20260812 16:42:27.427618 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.418739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34656 (local address 127.21.114.126:35983)
0812 16:42:27.418804 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.418806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.419029 (+ 223us) server_negotiation.cc:407] Connection header received
0812 16:42:27.419531 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.419532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.419546 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.419602 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.420215 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.420785 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.421982 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.422178 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.422259 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.424295 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.424297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.424297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.424322 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.426032 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.426523 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.426524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.426524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.426583 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.426882 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.426883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.426884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.427087 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.427154 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.427437 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.427526 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:42:27.427663 2132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.418709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:34656)
0812 16:42:27.418908 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.418943 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.419413 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.419686 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.419689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.419933 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.420115 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.420118 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.420883 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.420884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.421881 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.421884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.422266 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.422267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.422394 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.422824 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.422832 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.424169 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.426122 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.426128 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.426130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.426434 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.426649 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.426650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.426650 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.426791 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.427166 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.427172 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.427303 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.427385 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.427498 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":101,"threads_started":1}
I20260812 16:42:27.428385 2129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.125@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
I20260812 16:42:27.434607 2138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.424712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55066 (local address 127.21.114.125:43639)
0812 16:42:27.424892 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.424897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.425216 (+ 319us) server_negotiation.cc:407] Connection header received
0812 16:42:27.425249 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.425251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.425266 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.425363 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.426122 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.427098 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.428128 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.428616 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.428681 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.431358 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.431364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.431365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.431371 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.433273 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.433658 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.433662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.433663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.433741 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.433956 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.433957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.433958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.434166 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.434360 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.434410 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.434489 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260812 16:42:27.436586 2132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.428629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55074)
0812 16:42:27.428680 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.428691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.428737 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.428966 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.428967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.429121 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.429204 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.429206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.429853 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.429854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.430514 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.430517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.431039 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.431040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.431101 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.431488 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.431493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.432942 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.435543 (+ 2601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.435543 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.435544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.435709 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.435915 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.435916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.435916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.435973 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.436228 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.436228 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.436265 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.436367 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.436461 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 16:42:27.436672 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.428711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.21.114.125:43639)
0812 16:42:27.428851 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.428852 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.428857 (+ 5us) server_negotiation.cc:407] Connection header received
0812 16:42:27.428870 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.428870 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.428876 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.428925 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.429303 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.429766 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.430606 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.430943 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.431015 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.433030 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.433031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.433032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.433038 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.435451 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.435780 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.435781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.435781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.435838 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.436043 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.436044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.436045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.436152 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.436226 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.436391 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.436512 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":113,"thread_start_us":92,"threads_started":1}
I20260812 16:42:27.437995 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Bootstrap starting.
I20260812 16:42:27.438665 2129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:27.438985 2129 log.cc:824] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:27.439826 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: No bootstrap required, opened a new log
I20260812 16:42:27.441406 2129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } }
I20260812 16:42:27.441571 2129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:27.441597 2129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e6e80bfa4944e6b72d9aeb3bccf262, State: Initialized, Role: FOLLOWER
I20260812 16:42:27.441757 2129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } }
I20260812 16:42:27.442036 2144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } } }
I20260812 16:42:27.442076 2129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:27.442117 2144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 16:42:27.443773 2168 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:27.443830 2168 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:27.445472 1995 master_runner.cc:428] Detected that this master 92e6e80bfa4944e6b72d9aeb3bccf262 is joining an existing cluster
I20260812 16:42:27.445534 1995 master_runner.cc:432] Initiating AddMaster RPC to add 127.21.114.125:43639
I20260812 16:42:27.453858 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.446541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34672 (local address 127.21.114.126:35983)
0812 16:42:27.446582 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.446584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.446730 (+ 146us) server_negotiation.cc:407] Connection header received
0812 16:42:27.446892 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.446894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.446905 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.446964 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.447428 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.448142 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.449246 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.449436 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.449525 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.450619 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.450620 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.450621 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.450628 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.452086 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.452896 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.452897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.452897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.452964 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.453205 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.453207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.453207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.453352 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.453421 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.453673 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.453760 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:27.453868 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.446485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:34672)
0812 16:42:27.446641 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.446652 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.446807 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.447013 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.447014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.447286 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.447358 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.447360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.448229 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.448231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.449156 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.449159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.449540 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.449541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.449612 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.450091 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.450096 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.450526 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.452192 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.452193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.452194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.452800 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.453053 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.453054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.453054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.453123 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.453451 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.453452 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.453494 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.453614 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.453765 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260812 16:42:27.455302 2183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.446717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55088)
0812 16:42:27.446846 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.446854 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.446902 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.447013 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.447014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.447246 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.447296 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.447297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.449261 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.449261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.450101 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.450104 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.450893 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.450894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.450973 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.451746 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.451751 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.452125 (+ 374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.454216 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.454217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.454218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.454450 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.454687 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.454688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.454689 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.454755 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.455017 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.455018 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.455048 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.455112 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.455198 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260812 16:42:27.455600 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.446767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55088 (local address 127.21.114.125:43639)
0812 16:42:27.446801 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.446803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.446890 (+ 87us) server_negotiation.cc:407] Connection header received
0812 16:42:27.446953 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.446953 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.446962 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.447000 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.447381 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.448136 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.450190 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.450526 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.450598 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.452247 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.452248 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.452248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.452255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.454136 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.454550 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.454552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.454552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.454609 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.454828 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.454829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.454829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.454940 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.454980 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.455418 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.455504 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.126@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
I20260812 16:42:27.461413 2144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:27.461510 2144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } }
I20260812 16:42:27.461751 2144 leader_election.cc:288] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983)
I20260812 16:42:27.462158 1117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "040f6bc8c526460195968f7952f6fe48" is_pre_election: true
I20260812 16:42:27.462517 2030 leader_election.cc:302] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 92e6e80bfa4944e6b72d9aeb3bccf262; no voters: 040f6bc8c526460195968f7952f6fe48
I20260812 16:42:27.462683 2144 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 16:42:27.463828 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.456442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55100)
0812 16:42:27.456584 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.456615 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.456723 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.456853 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.456857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.457114 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.457157 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.457159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.457757 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.457757 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.458326 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.458328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.458676 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.458677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.458754 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.459209 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.459214 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.460886 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.462857 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.462863 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.462865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.463060 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.463273 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.463273 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.463274 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.463319 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.463587 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.463590 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.463627 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.463683 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.463764 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260812 16:42:27.463899 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.456489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55100 (local address 127.21.114.125:43639)
0812 16:42:27.456523 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.456525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.456698 (+ 173us) server_negotiation.cc:407] Connection header received
0812 16:42:27.456790 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.456791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.456801 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.456850 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.457241 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.457667 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.458425 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.458603 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.458676 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.460985 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.460986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.460987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.460994 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.462771 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.463139 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.463140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.463140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.463204 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.463379 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.463380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.463380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.463513 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.463599 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.463746 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.463817 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:27.464586 1097 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.21.114.125:43639: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
member_type: NON_VOTER
last_known_addr {
host: "127.21.114.125"
port: 43639
}
attrs {
promote: true
}
}
dest_uuid: "040f6bc8c526460195968f7952f6fe48"
cas_config_opid_index: -1
I20260812 16:42:27.464885 1097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } }
I20260812 16:42:27.465322 2193 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 92e6e80bfa4944e6b72d9aeb3bccf262 (127.21.114.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } }
I20260812 16:42:27.465646 2078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:27.466421 2193 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.21.114.125:43639
I20260812 16:42:27.466724 1995 master.cc:537] Master@127.21.114.125:43639 shutting down...
I20260812 16:42:27.466838 2078 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Refusing update from remote peer 040f6bc8c526460195968f7952f6fe48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 16:42:27.467268 2190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } }
I20260812 16:42:27.467447 2190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:27.467937 2190 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 16:42:27.468698 1074 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 16:42:27.469159 1074 consensus_peers.cc:487] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 -> Peer 92e6e80bfa4944e6b72d9aeb3bccf262 (127.21.114.125:43639): Couldn't send request to peer 92e6e80bfa4944e6b72d9aeb3bccf262. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 16:42:27.469578 1995 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:27.469641 1995 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:27.469673 1995 tablet_replica.cc:330] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: stopping tablet replica
I20260812 16:42:27.482313 1995 master.cc:552] Master@127.21.114.125:43639 shutdown complete.
I20260812 16:42:27.482362 1995 master_runner.cc:305] Clearing existing system tablet
I20260812 16:42:27.482470 1995 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.482507 1995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.483104 1995 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:27.483582 2198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.483702 1995 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.483762 1995 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.483786 1995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "576a210a77c89394aa272cbc66face46"
server_key_iv: "2d2e437dce2eaaf0349f90784c2a6cad"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.484874 1995 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:27.486210 1995 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 16:42:27.486274 1995 log.cc:1196] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 16:42:27.486459 1995 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Deleting consensus metadata
I20260812 16:42:27.486554 1995 master_runner.cc:315] Copying system tablet from 127.21.114.126:35983
I20260812 16:42:27.487164 1995 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: tablet copy: Beginning tablet copy session from remote peer at address 127.21.114.126:35983
I20260812 16:42:27.493947 2211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.487468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:34680)
0812 16:42:27.487571 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.487580 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.487644 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.487796 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.487796 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.487943 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.488000 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.488001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.488981 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.488982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.489544 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.489546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.490150 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.490151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.490210 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.490759 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.490764 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.491092 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.492923 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.492924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.492925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.493108 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.493336 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.493336 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.493337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.493393 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.493670 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.493671 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.493709 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.493762 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.493865 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"thread_start_us":63,"threads_started":1}
I20260812 16:42:27.494041 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.487522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34680 (local address 127.21.114.126:35983)
0812 16:42:27.487568 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.487570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.487646 (+ 76us) server_negotiation.cc:407] Connection header received
0812 16:42:27.487710 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.487711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.487730 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.487793 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.488069 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.488885 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.489637 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.489949 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.490059 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.491186 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.491187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.491188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.491195 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.492837 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.493190 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.493191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.493192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.493261 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.493460 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.493461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.493461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.493603 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.493675 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.493858 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.493943 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:27.494314 1135 tablet_copy_service.cc:140] P 040f6bc8c526460195968f7952f6fe48: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 92e6e80bfa4944e6b72d9aeb3bccf262 ({username='oryx', principal='oryx/127.21.114.125@KRBTEST.COM'} at 127.0.0.1:34680)
I20260812 16:42:27.494397 1135 tablet_copy_service.cc:161] P 040f6bc8c526460195968f7952f6fe48: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 92e6e80bfa4944e6b72d9aeb3bccf262 at {username='oryx', principal='oryx/127.21.114.125@KRBTEST.COM'} at 127.0.0.1:34680: session id = 92e6e80bfa4944e6b72d9aeb3bccf262-00000000000000000000000000000000
I20260812 16:42:27.495047 1135 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 16:42:27.495636 1995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 16:42:27.496712 1995 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: tablet copy: Starting download of 0 data blocks...
I20260812 16:42:27.496878 1995 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: tablet copy: Starting download of 1 WAL segments...
I20260812 16:42:27.497861 1995 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 16:42:27.498665 1135 tablet_copy_service.cc:342] P 040f6bc8c526460195968f7952f6fe48: Request end of tablet copy session 92e6e80bfa4944e6b72d9aeb3bccf262-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.21.114.125@KRBTEST.COM'} at 127.0.0.1:34680
I20260812 16:42:27.498725 1135 tablet_copy_service.cc:433] P 040f6bc8c526460195968f7952f6fe48: ending tablet copy session 92e6e80bfa4944e6b72d9aeb3bccf262-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 92e6e80bfa4944e6b72d9aeb3bccf262
I20260812 16:42:27.501286 1995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.502573 2219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.502703 2220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.502736 2222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.502942 1995 server_base.cc:1034] running on GCE node
I20260812 16:42:27.503119 1995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.503337 1995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.504513 1995 hybrid_clock.cc:648] HybridClock initialized: now 1786552947504501 us; error 29 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.505910 1995 init.cc:377] Logged in from keytab as oryx/127.21.114.125@KRBTEST.COM (short username oryx)
I20260812 16:42:27.506206 1995 webserver.cc:460] Webserver started at http://127.21.114.125:46725/ using document root <none> and password file <none>
I20260812 16:42:27.506320 1995 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.506348 1995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.506939 1995 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:27.507455 2236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.507617 1995 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:27.507681 1995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "576a210a77c89394aa272cbc66face46"
server_key_iv: "2d2e437dce2eaaf0349f90784c2a6cad"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.507727 1995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.526697 1995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.528613 1995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.532009 1995 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.125:43639
I20260812 16:42:27.532035 2328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.125:43639 every 8 connection(s)
I20260812 16:42:27.532366 1995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
I20260812 16:42:27.533293 2329 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:42:27.533872 2329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Bootstrap starting.
I20260812 16:42:27.537268 2329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:42:27.537530 2329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: Bootstrap complete.
I20260812 16:42:27.537740 2329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } }
I20260812 16:42:27.537825 2329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92e6e80bfa4944e6b72d9aeb3bccf262, State: Initialized, Role: LEARNER
I20260812 16:42:27.537866 2329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } }
I20260812 16:42:27.538055 2329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:27.538069 2340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } }
I20260812 16:42:27.538188 2340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: LEARNER
I20260812 16:42:27.539783 2357 catalog_manager.cc:1259] Loaded cluster ID: 88c1d85c70264f50a1b00c579dd84733
I20260812 16:42:27.539824 2357 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: loading cluster ID for follower catalog manager: success
I20260812 16:42:27.541046 2357 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: acquiring CA information for follower catalog manager: success
I20260812 16:42:27.541431 2357 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:42:27.548975 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.536564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55124 (local address 127.21.114.125:43639)
0812 16:42:27.536719 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.536721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.536814 (+ 93us) server_negotiation.cc:407] Connection header received
0812 16:42:27.536844 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.536844 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.536856 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.537030 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.541963 (+ 4933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.543053 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.543865 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.544105 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.544196 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.545621 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.545623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.545623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.545631 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.547484 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.547911 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.547913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.547913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.547986 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.548220 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.548221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.548222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.548431 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.548556 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.548675 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.548795 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for oryx/127.21.114.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.124.keytab.
Entry for principal oryx/127.21.114.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.124.keytab.
I20260812 16:42:27.579411 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:44451
--webserver_interface=127.21.114.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.124.keytab
--principal=oryx/127.21.114.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:27.664498 2367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:27.664693 2367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:27.664716 2367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:27.666023 2367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:27.666079 2367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:27.666116 2367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:27.666149 2367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:27.666169 2367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:27.668442 2367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.124.keytab
--principal=oryx/127.21.114.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:44451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.114.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:27.668751 2367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:27.669044 2367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.674170 2380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.674178 2378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.674367 2367 server_base.cc:1034] running on GCE node
W20260812 16:42:27.674180 2377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.674881 2367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.675235 2367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.676373 2367 hybrid_clock.cc:648] HybridClock initialized: now 1786552947676354 us; error 29 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.678957 2367 init.cc:377] Logged in from keytab as oryx/127.21.114.124@KRBTEST.COM (short username oryx)
I20260812 16:42:27.679536 2367 webserver.cc:460] Webserver started at http://127.21.114.124:43327/ using document root <none> and password file <none>
I20260812 16:42:27.679733 2367 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.679777 2367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.679877 2367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:27.680999 2367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/instance:
uuid: "eeebd5bc41e846749bd61a04e5b9cf20"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "419bfd5b58c5ab3336a9cecad2e24cb3"
server_key_iv: "5bb14bb2e6752cc3a61a9ba4bd235893"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.681321 2367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal/instance:
uuid: "eeebd5bc41e846749bd61a04e5b9cf20"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "419bfd5b58c5ab3336a9cecad2e24cb3"
server_key_iv: "5bb14bb2e6752cc3a61a9ba4bd235893"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.682608 2367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:27.683310 2398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.683502 2367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:27.683579 2367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
uuid: "eeebd5bc41e846749bd61a04e5b9cf20"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "419bfd5b58c5ab3336a9cecad2e24cb3"
server_key_iv: "5bb14bb2e6752cc3a61a9ba4bd235893"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.683676 2367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.694721 2367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.697178 2367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:27.697345 2367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.701442 2367 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.124:44451
I20260812 16:42:27.701473 2497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.124:44451 every 8 connection(s)
I20260812 16:42:27.701838 2367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
I20260812 16:42:27.702924 2499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:27.704541 2499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:42:27.705029 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 2367
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.124@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.114.124@KRBTEST.COM
I20260812 16:42:27.714784 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.705428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34688 (local address 127.21.114.126:35983)
0812 16:42:27.705479 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.705482 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.705639 (+ 157us) server_negotiation.cc:407] Connection header received
0812 16:42:27.706237 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.706238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.706252 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.706308 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.706847 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.707372 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.708537 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.708844 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.708924 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.711391 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.711393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.711393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.711402 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.713323 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.713769 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.713771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.713772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.713838 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.714098 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.714099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.714100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.714236 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.714315 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.714603 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.714694 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 16:42:27.714988 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.705313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:34688)
0812 16:42:27.705488 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.705539 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.706120 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.706327 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.706330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.706592 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.706745 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.706750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.707496 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.707497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.708445 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.708448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.708963 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.708965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.709078 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.709629 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.709640 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.711295 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.713421 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.713427 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.713429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.713690 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.713912 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.713913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.713913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.714015 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.714319 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.714326 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.714457 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.714566 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.714721 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260812 16:42:27.715193 2509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.705687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48880 (local address 127.21.114.124:44451)
0812 16:42:27.705898 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.705912 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.705942 (+ 30us) server_negotiation.cc:407] Connection header received
0812 16:42:27.706121 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.706127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.706146 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.706275 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.706945 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.707884 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.708887 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.709261 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.709340 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.711947 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.711956 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.711956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.711963 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.713950 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.714316 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.714319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.714320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.714386 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.714604 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.714605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.714606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.714752 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.714921 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.714994 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.715071 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
I20260812 16:42:27.715899 2499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.124@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
I20260812 16:42:27.721688 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.716201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55128)
0812 16:42:27.716264 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.716276 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.716356 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.716477 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.716478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.716588 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.716618 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.716619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.717202 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.717203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.717677 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.717678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.718018 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.718019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.718062 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.718395 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.718399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.719488 (+ 1089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.720923 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.720924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.720924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.721080 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.721237 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.721238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.721238 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.721289 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.721474 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.721475 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.721509 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.721560 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.721627 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 16:42:27.721704 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.716290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55128 (local address 127.21.114.125:43639)
0812 16:42:27.716360 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.716362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.716371 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:27.716422 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.716423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.716432 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.716476 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.716667 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.717138 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.717752 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.717952 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.718003 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.719579 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.719580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.719580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.719587 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.720847 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.721138 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.721139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.721139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.721182 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.721332 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.721333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.721333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.721424 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.721470 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.721575 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.721641 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:42:27.722189 2499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.124@KRBTEST.COM for oryx/127.21.114.124@KRBTEST.COM
I20260812 16:42:27.727830 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.722471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.0.0.1:48884)
0812 16:42:27.722525 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.722536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.722577 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.722683 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.722684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.722791 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.722817 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.722818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.723403 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.723404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.723845 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.723846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.724172 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.724172 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.724209 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.724580 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.724584 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.725692 (+ 1108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.726966 (+ 1274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.726967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.726968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.727130 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.727311 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.727311 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.727312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.727364 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.727593 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.727593 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.727640 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.727697 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.727770 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 16:42:27.727967 2509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.722523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.21.114.124:44451)
0812 16:42:27.722558 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.722560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.722566 (+ 6us) server_negotiation.cc:407] Connection header received
0812 16:42:27.722634 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.722634 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.722642 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.722682 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.722885 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.723321 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.723915 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.724104 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.724154 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.725770 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.725771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.725772 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.725778 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.726896 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.727198 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.727199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.727199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.727249 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.727419 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.727419 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.727420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.727527 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.727575 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.727731 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.727818 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":20}
I20260812 16:42:27.729336 2499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Bootstrap starting.
I20260812 16:42:27.730221 2499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:27.730525 2499 log.cc:824] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:27.731329 2499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: No bootstrap required, opened a new log
I20260812 16:42:27.732843 2499 raft_consensus.cc:348] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } }
I20260812 16:42:27.733001 2499 raft_consensus.cc:374] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:27.733054 2499 raft_consensus.cc:729] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeebd5bc41e846749bd61a04e5b9cf20, State: Initialized, Role: FOLLOWER
I20260812 16:42:27.733192 2499 consensus_queue.cc:260] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } }
I20260812 16:42:27.733525 2499 sys_catalog.cc:564] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:27.733528 2511 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } } }
I20260812 16:42:27.733695 2511 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 16:42:27.735355 2531 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:42:27.735421 2531 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:42:27.737811 2367 master_runner.cc:428] Detected that this master eeebd5bc41e846749bd61a04e5b9cf20 is joining an existing cluster
I20260812 16:42:27.737856 2367 master_runner.cc:432] Initiating AddMaster RPC to add 127.21.114.124:44451
I20260812 16:42:27.747325 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.739157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.21.114.125:43639)
0812 16:42:27.739212 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.739214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.741120 (+ 1906us) server_negotiation.cc:407] Connection header received
0812 16:42:27.741217 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.741217 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.741228 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.741258 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.741687 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.742426 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.743476 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.743730 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.743818 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.744767 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.744769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.744769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.744776 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.746121 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.746493 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.746495 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.746495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.746555 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.746797 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.746798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.746798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.746918 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.746991 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.747161 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.747233 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 16:42:27.747361 2540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.739132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55142)
0812 16:42:27.741058 (+ 1926us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.741069 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.741145 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.741320 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.741320 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.741529 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.741593 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.741595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.742530 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.742531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.743384 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.743386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.743875 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.743877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.743949 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.744381 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.744386 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.744663 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.746230 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.746231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.746231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.746415 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.746634 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.746635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.746636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.746718 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.746996 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.746997 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.747040 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.747123 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.747229 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1910,"thread_start_us":93,"threads_started":1}
I20260812 16:42:27.763741 2547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.739118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.0.0.1:48890)
0812 16:42:27.739299 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.739313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.739400 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.739528 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.739529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.739763 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.739862 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.739866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.740825 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.740826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.741826 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.741828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.742296 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.742297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.742364 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.742871 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.742877 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.743207 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.762316 (+ 19109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.762316 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.762317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.762483 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.762700 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.762701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.762701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.762807 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.763329 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.763330 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.763403 (+ 73us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.763474 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.763605 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":2,"thread_start_us":139,"threads_started":1}
I20260812 16:42:27.763751 2509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.738955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.21.114.124:44451)
0812 16:42:27.738993 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.738995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.739385 (+ 390us) server_negotiation.cc:407] Connection header received
0812 16:42:27.739458 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.739459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.739469 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.739524 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.740017 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.740748 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.741906 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.742170 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.742208 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.743331 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.743332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.743332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.743339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.762221 (+ 18882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.762565 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.762566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.762566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.762625 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.763091 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.763092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.763093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.763243 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.763317 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.763531 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.763669 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":19}
I20260812 16:42:27.769244 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 1221
I20260812 16:42:27.770498 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.738935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34696 (local address 127.21.114.126:35983)
0812 16:42:27.738979 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.738982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.739362 (+ 380us) server_negotiation.cc:407] Connection header received
0812 16:42:27.739464 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.739465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.739477 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.739510 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.740004 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.740771 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.741920 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.742218 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.742258 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.762026 (+ 19768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.762028 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.762028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.762037 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.769069 (+ 7032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.769489 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.769490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.769491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.769554 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.769747 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.769748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.769748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.769926 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.769982 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.770241 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.770345 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:27.770941 2541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.738857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:34696)
0812 16:42:27.739297 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.739309 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.739390 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.739574 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.739575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.739820 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.739890 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.739892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.740872 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.740873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.741786 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.741789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.742339 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.742339 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.742398 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.761326 (+ 18928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.761334 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.761878 (+ 544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.769155 (+ 7277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.769156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.769157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.769394 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.769624 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.769624 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.769625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.769684 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.770040 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.770041 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.770096 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.770608 (+ 512us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.770754 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":38,"thread_start_us":138,"threads_started":1}
I20260812 16:42:27.791888 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:40657
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:35983
--webserver_port=34675
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552946, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.126@KRBTEST.COM for oryx/127.21.114.124@KRBTEST.COM
I20260812 16:42:27.798152 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.788629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.0.0.1:48898)
0812 16:42:27.788696 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.788709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.788758 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.791598 (+ 2840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.791599 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.791781 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.791827 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.791829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.792684 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.792686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.793210 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.793212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.793600 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.793601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.793680 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.794137 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.794149 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.795396 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.797065 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.797066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.797067 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.797253 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.797472 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.797473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.797474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.797535 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.797811 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.797812 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.797859 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.797942 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.798057 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 16:42:27.798151 2509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.791399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48898 (local address 127.21.114.124:44451)
0812 16:42:27.791466 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.791468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.791477 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:27.791517 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.791518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.791529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.791590 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.791932 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.792586 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.793316 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.793518 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.793600 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.795498 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.795499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.795499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.795507 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.796956 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.797340 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.797341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.797341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.797401 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.797614 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.797615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.797615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.797730 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.797806 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.797983 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.798054 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:27.799057 1097 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.21.114.124:44451: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20"
member_type: NON_VOTER
last_known_addr {
host: "127.21.114.124"
port: 44451
}
attrs {
promote: true
}
}
dest_uuid: "040f6bc8c526460195968f7952f6fe48"
cas_config_opid_index: 5
I20260812 16:42:27.799337 1097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } }
I20260812 16:42:27.799870 2193 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.800791 2193 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.21.114.124:44451
I20260812 16:42:27.800876 2193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.800977 2193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:27.801265 2367 master.cc:537] Master@127.21.114.124:44451 shutting down...
I20260812 16:42:27.801412 2448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:27.802975 2448 raft_consensus.cc:1261] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Refusing update from remote peer 040f6bc8c526460195968f7952f6fe48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 16:42:27.803503 2190 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 16:42:27.804152 1069 consensus_peers.cc:487] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 -> Peer eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124:44451): Couldn't send request to peer eeebd5bc41e846749bd61a04e5b9cf20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 16:42:27.805814 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.799823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55146)
0812 16:42:27.801567 (+ 1744us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.801580 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.801636 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.801906 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.801907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.801910 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:27.801953 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.801954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.802988 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.802989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.804161 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.804164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.805542 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.805543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.805616 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.805644 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.805700 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.805747 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1725}
I20260812 16:42:27.806310 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.799889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55146 (local address 127.21.114.125:43639)
0812 16:42:27.799933 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.799935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.801695 (+ 1760us) server_negotiation.cc:407] Connection header received
0812 16:42:27.801747 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.801750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.801776 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.801837 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:27.802033 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.802832 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.804256 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.805065 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.805142 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.805503 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.806174 (+ 671us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.806229 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:27.806527 2281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 LEARNER]: Refusing update from remote peer 040f6bc8c526460195968f7952f6fe48: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 16:42:27.806728 2190 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 16:42:27.807473 2281 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.808969 2190 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: attempting to promote NON_VOTER 92e6e80bfa4944e6b72d9aeb3bccf262 to VOTER
I20260812 16:42:27.809037 2340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 040f6bc8c526460195968f7952f6fe48. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.809114 2340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: LEARNER
I20260812 16:42:27.809149 2340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: NON_VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: true } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.809185 2340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: LEARNER
I20260812 16:42:27.809206 2190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } }
I20260812 16:42:27.810194 2367 raft_consensus.cc:2229] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:27.810304 2367 raft_consensus.cc:2258] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:27.810369 2367 tablet_replica.cc:330] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: stopping tablet replica
I20260812 16:42:27.810577 2281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 LEARNER]: Refusing update from remote peer 040f6bc8c526460195968f7952f6fe48: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260812 16:42:27.810828 1069 consensus_peers.cc:487] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 -> Peer eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124:44451): Couldn't send request to peer eeebd5bc41e846749bd61a04e5b9cf20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 16:42:27.810995 2193 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 16:42:27.812354 2190 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 92e6e80bfa4944e6b72d9aeb3bccf262 (127.21.114.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.813439 2190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.813439 2554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.813544 2190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:27.813550 2554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:27.813938 2281 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 92e6e80bfa4944e6b72d9aeb3bccf262 (127.21.114.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.814760 2553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.814862 2553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:42:27.823771 2367 master.cc:552] Master@127.21.114.124:44451 shutdown complete.
I20260812 16:42:27.823856 2367 master_runner.cc:305] Clearing existing system tablet
I20260812 16:42:27.823997 2367 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.824066 2367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.824803 2367 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:27.825352 2563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.825493 2367 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.825549 2367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:27.825578 2367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
uuid: "eeebd5bc41e846749bd61a04e5b9cf20"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "419bfd5b58c5ab3336a9cecad2e24cb3"
server_key_iv: "5bb14bb2e6752cc3a61a9ba4bd235893"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.826215 2367 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:27.827728 2367 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 16:42:27.827821 2367 log.cc:1196] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 16:42:27.828027 2367 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Deleting consensus metadata
I20260812 16:42:27.828181 2367 master_runner.cc:315] Copying system tablet from 127.21.114.126:35983
I20260812 16:42:27.828917 2367 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: tablet copy: Beginning tablet copy session from remote peer at address 127.21.114.126:35983
I20260812 16:42:27.835569 2572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.829276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:34702)
0812 16:42:27.829405 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.829416 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.829478 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.829618 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.829619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.829806 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.829858 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.829861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.830567 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.830568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.831108 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.831110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.831503 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.831504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.831562 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.832081 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.832087 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.832516 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.834392 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.834393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.834394 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.834575 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.834822 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.834823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.834823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.834943 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.835222 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.835224 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.835270 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.835362 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.835473 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260812 16:42:27.835565 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.829325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34702 (local address 127.21.114.126:35983)
0812 16:42:27.829393 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.829395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.829462 (+ 67us) server_negotiation.cc:407] Connection header received
0812 16:42:27.829543 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.829543 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.829554 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.829613 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.829953 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.830465 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.831199 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.831421 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.831505 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.832625 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.832626 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.832626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.832634 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.834275 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.834669 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.834670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.834671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.834741 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.835020 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.835021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.835021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.835144 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.835221 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.835391 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.835471 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:42:27.836151 1135 tablet_copy_service.cc:140] P 040f6bc8c526460195968f7952f6fe48: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer eeebd5bc41e846749bd61a04e5b9cf20 ({username='oryx', principal='oryx/127.21.114.124@KRBTEST.COM'} at 127.0.0.1:34702)
I20260812 16:42:27.836244 1135 tablet_copy_service.cc:161] P 040f6bc8c526460195968f7952f6fe48: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer eeebd5bc41e846749bd61a04e5b9cf20 at {username='oryx', principal='oryx/127.21.114.124@KRBTEST.COM'} at 127.0.0.1:34702: session id = eeebd5bc41e846749bd61a04e5b9cf20-00000000000000000000000000000000
I20260812 16:42:27.836835 1135 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 16:42:27.837343 2367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 16:42:27.838909 2367 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: tablet copy: Starting download of 0 data blocks...
I20260812 16:42:27.839190 2367 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: tablet copy: Starting download of 1 WAL segments...
I20260812 16:42:27.840049 2367 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 16:42:27.841024 1135 tablet_copy_service.cc:342] P 040f6bc8c526460195968f7952f6fe48: Request end of tablet copy session eeebd5bc41e846749bd61a04e5b9cf20-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.21.114.124@KRBTEST.COM'} at 127.0.0.1:34702
I20260812 16:42:27.841110 1135 tablet_copy_service.cc:433] P 040f6bc8c526460195968f7952f6fe48: ending tablet copy session eeebd5bc41e846749bd61a04e5b9cf20-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer eeebd5bc41e846749bd61a04e5b9cf20
I20260812 16:42:27.843829 2367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.845031 2574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.845254 2576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.845451 2580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.848503 2367 server_base.cc:1034] running on GCE node
I20260812 16:42:27.848642 2367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.848845 2367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.849997 2367 hybrid_clock.cc:648] HybridClock initialized: now 1786552947849992 us; error 24 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.851462 2367 init.cc:377] Logged in from keytab as oryx/127.21.114.124@KRBTEST.COM (short username oryx)
I20260812 16:42:27.851794 2367 webserver.cc:460] Webserver started at http://127.21.114.124:41227/ using document root <none> and password file <none>
I20260812 16:42:27.851918 2367 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.851955 2367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.852658 2367 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:27.853256 2596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.853422 2367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:27.853472 2367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
uuid: "eeebd5bc41e846749bd61a04e5b9cf20"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "419bfd5b58c5ab3336a9cecad2e24cb3"
server_key_iv: "5bb14bb2e6752cc3a61a9ba4bd235893"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.853538 2367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.872411 2367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.874210 2367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.877697 2367 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.124:44451
I20260812 16:42:27.878098 2367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
I20260812 16:42:27.879087 2705 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:42:27.879501 2705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Bootstrap starting.
I20260812 16:42:27.882021 2705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:42:27.882254 2705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Bootstrap complete.
I20260812 16:42:27.882472 2705 raft_consensus.cc:348] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } }
I20260812 16:42:27.882567 2705 raft_consensus.cc:729] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eeebd5bc41e846749bd61a04e5b9cf20, State: Initialized, Role: LEARNER
I20260812 16:42:27.882614 2705 consensus_queue.cc:260] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } }
I20260812 16:42:27.882827 2705 sys_catalog.cc:564] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:27.882799 2716 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:27.883004 2716 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: This master's current role is: LEARNER
I20260812 16:42:27.884382 2737 catalog_manager.cc:1259] Loaded cluster ID: 88c1d85c70264f50a1b00c579dd84733
I20260812 16:42:27.884467 2737 catalog_manager.cc:1552] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: loading cluster ID for follower catalog manager: success
I20260812 16:42:27.885614 2737 catalog_manager.cc:1574] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: acquiring CA information for follower catalog manager: success
I20260812 16:42:27.885905 2737 catalog_manager.cc:1602] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:42:27.888448 2704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.124:44451 every 8 connection(s)
W20260812 16:42:27.925009 2548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:27.925302 2548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:27.925338 2548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:27.927078 2548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:27.927139 2548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:27.927181 2548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:27.929478 2548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:40657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=34675
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:27.929796 2548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:27.930079 2548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:27.935737 2753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.935766 2757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:27.935703 2750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:27.935994 2548 server_base.cc:1034] running on GCE node
I20260812 16:42:27.936188 2548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:27.936663 2548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:27.937848 2548 hybrid_clock.cc:648] HybridClock initialized: now 1786552947937831 us; error 35 us; skew 500 ppm
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:27.941401 2548 init.cc:377] Logged in from keytab as oryx/127.21.114.65@KRBTEST.COM (short username oryx)
I20260812 16:42:27.942003 2548 webserver.cc:460] Webserver started at http://127.21.114.65:34675/ using document root <none> and password file <none>
I20260812 16:42:27.942296 2548 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:27.942389 2548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:27.944185 2548 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 16:42:27.944972 2773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.945207 2548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:42:27.945283 2548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "542efa7b07bd4248aad75cc8491cb7d6"
format_stamp: "Formatted at 2026-08-12 16:42:26 on dist-test-slave-45dx"
server_key: "4374000ca4b0d3e1a8efcfee1c6e945f"
server_key_iv: "0ca21d32942785c7601955817494a54f"
server_key_version: "encryptionkey@0"
I20260812 16:42:27.945650 2548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:27.961624 2548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:27.963564 2548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:27.963686 2548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:27.963887 2548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:27.964160 2548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:27.964195 2548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.964218 2548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:27.964232 2548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:27.971091 2548 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:40657
I20260812 16:42:27.971151 2988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:40657 every 8 connection(s)
I20260812 16:42:27.971532 2548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:27.978961 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 2548
I20260812 16:42:27.979146 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 1486
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
Aug 12 16:42:27 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552947, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.124@KRBTEST.COM
I20260812 16:42:27.990121 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.972341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.21.114.65:47767)
0812 16:42:27.972531 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.972580 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.973719 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.974034 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.974037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.974377 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.974614 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.974619 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.975653 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.975654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.976753 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.976755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.977283 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.977283 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.977400 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.978382 (+ 982us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.978388 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.982613 (+ 4225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.988248 (+ 5635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.988258 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.988262 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.988730 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.989005 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.989006 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.989007 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.989145 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.989420 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.989425 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.989583 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.989669 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.989851 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":36,"thread_start_us":101,"threads_started":1}
I20260812 16:42:27.990594 3002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.972472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:47767 (local address 127.21.114.124:44451)
0812 16:42:27.972576 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.972579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.972702 (+ 123us) server_negotiation.cc:407] Connection header received
0812 16:42:27.973868 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.973869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.973885 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.973950 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.974725 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.975540 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.976857 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.977196 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.977276 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.982725 (+ 5449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.982726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.982727 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.982735 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.988138 (+ 5403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.988834 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.988835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.988836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.988925 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.989205 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.989206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.989206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.989346 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.989399 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.990350 (+ 951us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.990458 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":51,"threads_started":1}
I20260812 16:42:27.990936 2989 heartbeater.cc:347] Connected to a master server at 127.21.114.124:44451
I20260812 16:42:27.991022 2989 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:27.991199 2989 heartbeater.cc:511] Master 127.21.114.124:44451 requested a full tablet report, sending...
I20260812 16:42:27.991652 2627 ts_manager.cc:194] Registered new tserver with Master: 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65:40657)
I20260812 16:42:27.995993 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.972331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:48809 (local address 127.21.114.125:43639)
0812 16:42:27.972401 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.972403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.972722 (+ 319us) server_negotiation.cc:407] Connection header received
0812 16:42:27.973861 (+ 1139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.973862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.973877 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.973912 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.974728 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.975506 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.976906 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.977234 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.977298 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.981455 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.981457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.981457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.981464 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.994034 (+ 12570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995009 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.995011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.995011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.995080 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995332 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.995334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.995334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.995524 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.995596 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.995799 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.995901 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:27.996061 3001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.972342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.21.114.65:48809)
0812 16:42:27.972650 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.972660 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.973747 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.974035 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.974038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.974427 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.974616 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.974622 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.975649 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.975650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.976785 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.976788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.977372 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.977373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.977429 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.978073 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.978082 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.981343 (+ 3261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.994633 (+ 13290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.994635 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.994636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.994911 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.995155 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.995157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.995227 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.995589 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.995590 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.995648 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.995750 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.995882 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":144,"thread_start_us":104,"threads_started":1}
I20260812 16:42:27.996560 2992 heartbeater.cc:347] Connected to a master server at 127.21.114.125:43639
I20260812 16:42:27.996627 2992 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:27.996721 2992 heartbeater.cc:511] Master 127.21.114.125:43639 requested a full tablet report, sending...
I20260812 16:42:27.996773 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.972777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:50431 (local address 127.21.114.126:35983)
0812 16:42:27.972829 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:27.972831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:27.972842 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:27.973877 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:27.973879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:27.973892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:27.973924 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:27.974730 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.975508 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.976912 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.977125 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.977158 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.982747 (+ 5589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:27.982748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:27.982748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:27.982756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:27.994848 (+ 12092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995372 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.995374 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.995374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.995437 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995707 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:27.995708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:27.995709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:27.995852 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:27.995918 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:27.996586 (+ 668us) server_negotiation.cc:299] Negotiation successful
0812 16:42:27.996682 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:42:27.997087 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:27.972670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:50431)
0812 16:42:27.972793 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:27.972801 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:27.973746 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:27.974035 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:27.974038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:27.974425 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:27.974616 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.974622 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.975649 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.975650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.976785 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:27.976788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:27.977231 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:27.977232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:27.977400 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:27.978117 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:27.978122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:27.982649 (+ 4527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:27.995069 (+ 12420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.995071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.995291 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.995513 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:27.995514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:27.995514 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:27.995583 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:27.995948 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:27.995949 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:27.995993 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 16:42:27.996552 (+ 559us) client_negotiation.cc:240] Negotiation successful
0812 16:42:27.996740 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":104,"thread_start_us":62,"threads_started":1}
I20260812 16:42:27.997256 2261 ts_manager.cc:194] Registered new tserver with Master: 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65:40657)
I20260812 16:42:27.997611 2991 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35983
I20260812 16:42:27.997673 2991 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:27.997750 2991 heartbeater.cc:511] Master 127.21.114.126:35983 requested a full tablet report, sending...
I20260812 16:42:27.998061 1097 ts_manager.cc:194] Re-registered known tserver with Master: 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65:40657)
I20260812 16:42:27.998446 1097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:50431
I20260812 16:42:28.000563 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:44513
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:35983
--webserver_port=46633
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:28.091176 3015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:28.091454 3015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:28.091504 3015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:28.092972 3015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:28.093050 3015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:28.093098 3015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:28.094847 3015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:44513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=46633
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:28.095161 3015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:28.095495 3015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:28.101091 3026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:28.101135 3029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:28.101150 3027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:28.101311 3015 server_base.cc:1034] running on GCE node
I20260812 16:42:28.101514 3015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:28.101807 3015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:28.103018 3015 hybrid_clock.cc:648] HybridClock initialized: now 1786552948103018 us; error 44 us; skew 500 ppm
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:28.106036 3015 init.cc:377] Logged in from keytab as oryx/127.21.114.66@KRBTEST.COM (short username oryx)
I20260812 16:42:28.106563 3015 webserver.cc:460] Webserver started at http://127.21.114.66:46633/ using document root <none> and password file <none>
I20260812 16:42:28.106796 3015 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:28.106858 3015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:28.108492 3015 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:28.109233 3041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:28.109488 3015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:28.109596 3015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "82ec7562b78e422fb9d9abd83afe052c"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "a92fba338f4ff2ad3f8e3fff4f9c2a94"
server_key_iv: "d722f1d93a4f54ad172dc60effff7ade"
server_key_version: "encryptionkey@0"
I20260812 16:42:28.109961 3015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:28.123490 3015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:28.125825 3015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:28.125972 3015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:28.126225 3015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:28.126554 3015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:28.126588 3015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:28.126610 3015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:28.126660 3015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:28.132956 3015 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:44513
I20260812 16:42:28.133013 3278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:44513 every 8 connection(s)
I20260812 16:42:28.133394 3015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:28.136034 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 3015
I20260812 16:42:28.136200 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 1733
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:28.148990 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.134165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:46567 (local address 127.21.114.125:43639)
0812 16:42:28.134216 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.134218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.134724 (+ 506us) server_negotiation.cc:407] Connection header received
0812 16:42:28.135592 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.135594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.135609 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.135643 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.136841 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.137524 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.138897 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.139085 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.139115 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.142554 (+ 3439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.142555 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.142556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.142563 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.146894 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.147521 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.147523 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.147523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.147591 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.147967 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.147968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.147969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.148147 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.148200 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.148723 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.148839 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:42:28.149701 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.134169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.21.114.66:46567)
0812 16:42:28.134649 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.134660 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.135492 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.135742 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.135742 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.136359 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:28.136749 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.136750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.137642 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.137643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.138821 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.138824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.139198 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.139198 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.139349 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.140066 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:28.140078 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:28.142458 (+ 2380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:28.147002 (+ 4544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.147011 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.147015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.147418 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.147680 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.147681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.147682 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.147870 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.148257 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:28.148264 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:28.148516 (+ 252us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.149111 (+ 595us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.149351 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":324,"thread_start_us":106,"threads_started":1}
I20260812 16:42:28.154501 3283 heartbeater.cc:347] Connected to a master server at 127.21.114.125:43639
I20260812 16:42:28.154615 3283 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:28.154812 3283 heartbeater.cc:511] Master 127.21.114.125:43639 requested a full tablet report, sending...
I20260812 16:42:28.155244 2261 ts_manager.cc:194] Registered new tserver with Master: 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513)
I20260812 16:42:28.155771 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.134651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51327 (local address 127.21.114.126:35983)
0812 16:42:28.134703 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.134704 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.134714 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:28.135594 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.135595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.135609 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.135643 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.139526 (+ 3883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.140263 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.141227 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.141512 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.141545 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.143877 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.143878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.143879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.143887 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.154372 (+ 10485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.154827 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.154828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.154829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.154893 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.155090 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.155091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.155091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.155239 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.155302 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.155528 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.155630 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:42:28.156198 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.134477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.66:51327)
0812 16:42:28.134660 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.134670 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.135489 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.135741 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.135742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.139343 (+ 3601us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:28.139423 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.139425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.140399 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.140400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.141148 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.141151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.141632 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.141632 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.141700 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.142179 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:28.142184 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:28.143786 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:28.154464 (+ 10678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.154466 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.154466 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.154725 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.154964 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.154965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.154965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.155025 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.155356 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:28.155357 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:28.155408 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.155896 (+ 488us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.156019 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":69,"threads_started":1}
I20260812 16:42:28.156661 3281 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35983
I20260812 16:42:28.156718 3281 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:28.156806 3281 heartbeater.cc:511] Master 127.21.114.126:35983 requested a full tablet report, sending...
I20260812 16:42:28.157341 1097 ts_manager.cc:194] Re-registered known tserver with Master: 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513)
I20260812 16:42:28.157879 1097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:51327
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.124@KRBTEST.COM
I20260812 16:42:28.158594 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:40441
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:35983
--webserver_port=37691
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:42:28.161710 3285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.134169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.21.114.66:59943)
0812 16:42:28.134352 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.134390 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.135466 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.135731 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.135736 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.136265 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:28.136611 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.136617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.155419 (+ 18802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.155420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.156143 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.156145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.156672 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.156673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.156747 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.157221 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:28.157225 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:28.158637 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:28.160542 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.160543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.160544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.160712 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.160947 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.160947 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.160948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.161003 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.161307 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:28.161308 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:28.161357 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.161415 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.161497 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":2,"thread_start_us":106,"threads_started":1}
I20260812 16:42:28.161705 3002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.134469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:59943 (local address 127.21.114.124:44451)
0812 16:42:28.134521 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.134523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.134533 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:28.135588 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.135589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.135605 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.135659 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.154079 (+ 18420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.154869 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.156235 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.156609 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.156672 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.158755 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.158756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.158757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.158767 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.160455 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.160797 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.160799 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.160800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.160859 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.161082 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.161083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.161083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.161226 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.161286 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.161469 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.161569 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:28.162153 3280 heartbeater.cc:347] Connected to a master server at 127.21.114.124:44451
I20260812 16:42:28.162204 3280 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:28.162269 3280 heartbeater.cc:511] Master 127.21.114.124:44451 requested a full tablet report, sending...
I20260812 16:42:28.162556 2627 ts_manager.cc:194] Registered new tserver with Master: 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513)
I20260812 16:42:28.199621 3002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.197044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.21.114.124:44451)
0812 16:42:28.197121 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.197124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.197151 (+ 27us) server_negotiation.cc:407] Connection header received
0812 16:42:28.197181 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.197182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.197211 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.197286 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:28.197447 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.197937 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.198876 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.199281 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.199390 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.199473 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.199499 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.199538 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 16:42:28.199621 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.196935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.0.0.1:48912)
0812 16:42:28.197002 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.197035 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.197116 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.197292 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.197294 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.197296 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:28.197354 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.197361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.198037 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.198039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.198752 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.198754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.199384 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.199385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.199446 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.199450 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.199496 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.199545 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 16:42:28.199994 2639 raft_consensus.cc:1203] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 16:42:28.200193 2716 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 040f6bc8c526460195968f7952f6fe48. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:28.200366 2716 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: This master's current role is: LEARNER
W20260812 16:42:28.248314 3292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:28.248548 3292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:28.248571 3292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:28.249801 3292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:28.249845 3292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:28.249871 3292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:28.251349 3292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:40441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=37691
--tserver_master_addrs=127.21.114.126:35983,127.21.114.125:43639,127.21.114.124:44451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:28.251605 3292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:28.251873 3292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:28.257094 3298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:28.257104 3300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:28.257104 3310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:28.257455 3292 server_base.cc:1034] running on GCE node
I20260812 16:42:28.257655 3292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:28.257893 3292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:28.259040 3292 hybrid_clock.cc:648] HybridClock initialized: now 1786552948259028 us; error 55 us; skew 500 ppm
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:28.261761 3292 init.cc:377] Logged in from keytab as oryx/127.21.114.67@KRBTEST.COM (short username oryx)
I20260812 16:42:28.262384 3292 webserver.cc:460] Webserver started at http://127.21.114.67:37691/ using document root <none> and password file <none>
I20260812 16:42:28.262701 3292 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:28.262804 3292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:28.264914 3292 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:28.266000 3323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:28.266263 3292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:28.266376 3292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0"
format_stamp: "Formatted at 2026-08-12 16:42:27 on dist-test-slave-45dx"
server_key: "d886e8895c0af55807223cb650950bb9"
server_key_iv: "534ca43a3ea45c4f3f915ab1211599d0"
server_key_version: "encryptionkey@0"
I20260812 16:42:28.266820 3292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:28.287029 3292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:28.289438 3292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:28.289556 3292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:28.289739 3292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:28.290081 3292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:28.290117 3292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:28.290167 3292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:28.290194 3292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:28.296516 3292 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:40441
I20260812 16:42:28.296567 3535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:40441 every 8 connection(s)
I20260812 16:42:28.296921 3292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.124@KRBTEST.COM
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.125@KRBTEST.COM
I20260812 16:42:28.304769 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 3292
Aug 12 16:42:28 dist-test-slave-45dx krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552948, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:28.308545 3546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.297693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.21.114.67:41851)
0812 16:42:28.297997 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.298024 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.298543 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.298814 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.298815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.299187 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:28.299330 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.299333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.300061 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.300062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.301201 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.301204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.301660 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.301756 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.302504 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:28.302509 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:28.304215 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:28.306682 (+ 2467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.306690 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.306692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.306997 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.307289 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.307290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.307290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.307456 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.307774 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:28.307782 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:28.307951 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.308067 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.308256 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":2,"thread_start_us":136,"threads_started":1}
I20260812 16:42:28.308835 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.298213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:42921 (local address 127.21.114.126:35983)
0812 16:42:28.298285 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.298287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.298295 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:28.298641 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.298642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.298654 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.298690 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.299482 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.300197 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301312 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.301585 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301632 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.305360 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.305361 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.305361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.305369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.307228 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.307793 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.307794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.307794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.307865 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.308066 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.308067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.308067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.308192 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.308256 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.308609 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.308738 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":50}
I20260812 16:42:28.309101 3002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.297688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:41851 (local address 127.21.114.124:44451)
0812 16:42:28.297819 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.297821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.298077 (+ 256us) server_negotiation.cc:407] Connection header received
0812 16:42:28.298641 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.298642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.298660 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.298691 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.299448 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.299956 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301290 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.301580 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301661 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.304336 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.304338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.304339 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.304347 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.306324 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.307139 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.307141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.307141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.307210 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.307538 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.307539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.307540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.307684 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.307747 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.308902 (+ 1155us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.308989 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 16:42:28.309175 3547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.298031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:42921)
0812 16:42:28.298168 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.298178 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.298540 (+ 362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.299192 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.299193 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.299351 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:28.299414 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.299416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.300285 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.300286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.301205 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.301207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.301710 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.301793 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.302458 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:28.302469 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:28.305244 (+ 2775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:28.307455 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.307456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.307456 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.307674 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.307935 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.307936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.307936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.307995 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.308285 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:28.308286 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:28.308347 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.308411 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.308499 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":22,"thread_start_us":81,"threads_started":1}
I20260812 16:42:28.309443 3538 heartbeater.cc:347] Connected to a master server at 127.21.114.124:44451
I20260812 16:42:28.309533 3538 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:28.309708 3538 heartbeater.cc:511] Master 127.21.114.124:44451 requested a full tablet report, sending...
I20260812 16:42:28.310173 2627 ts_manager.cc:194] Registered new tserver with Master: 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441)
I20260812 16:42:28.310708 3539 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35983
I20260812 16:42:28.310775 3539 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:28.310854 3539 heartbeater.cc:511] Master 127.21.114.126:35983 requested a full tablet report, sending...
I20260812 16:42:28.311069 1097 ts_manager.cc:194] Re-registered known tserver with Master: 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441)
I20260812 16:42:28.311563 1097 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:42921
I20260812 16:42:28.312875 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.297693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.21.114.67:38877)
0812 16:42:28.297896 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.297941 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.298519 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.298794 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.298798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.299114 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:28.299328 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.299332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.300332 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.300333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.301044 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.301046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.301514 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.301678 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.302458 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:28.302469 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:28.305571 (+ 3102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:28.310608 (+ 5037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.310609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.310609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.310874 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.311713 (+ 839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:28.311714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:28.311715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:28.311787 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:28.312079 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:28.312080 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:28.312116 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.312178 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.312280 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":32,"thread_start_us":132,"threads_started":1}
I20260812 16:42:28.313203 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.297753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:38877 (local address 127.21.114.125:43639)
0812 16:42:28.297826 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.297829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.298036 (+ 207us) server_negotiation.cc:407] Connection header received
0812 16:42:28.298634 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.298636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.298648 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.298722 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.299430 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.300196 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301151 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.301426 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.301490 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.305671 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.305672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.305673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.305680 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.310399 (+ 4719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.311293 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.311295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.311295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.311373 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.311860 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.311861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.311862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.311992 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.312052 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.312997 (+ 945us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.313088 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:28.313512 3541 heartbeater.cc:347] Connected to a master server at 127.21.114.125:43639
I20260812 16:42:28.313553 3541 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:28.313609 3541 heartbeater.cc:511] Master 127.21.114.125:43639 requested a full tablet report, sending...
I20260812 16:42:28.314021 2261 ts_manager.cc:194] Registered new tserver with Master: 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441)
I20260812 16:42:28.316375 3561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.306889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.21.114.126:35983)
0812 16:42:28.307044 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.307046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.307281 (+ 235us) server_negotiation.cc:407] Connection header received
0812 16:42:28.307383 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.307384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.307398 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.307447 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.308400 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.309173 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.310213 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.310512 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.310552 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.312897 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.312898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.312899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.312906 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.314985 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.315464 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.315465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.315465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.315535 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.315806 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.315807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.315808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.315936 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.316059 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.316166 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.316250 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":101,"threads_started":1}
I20260812 16:42:28.318478 3565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.307325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48926 (local address 127.21.114.124:44451)
0812 16:42:28.307727 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.307729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.307738 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:28.307760 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.307761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.307772 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.308543 (+ 771us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.308577 (+ 34us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.309608 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.310622 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.310919 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.311421 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.312775 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.312777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.312777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.312786 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.316555 (+ 3769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.317017 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.317019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.317019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.317081 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.317665 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.317666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.317666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.317823 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.318234 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.318282 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.318368 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":65,"threads_started":1}
I20260812 16:42:28.319998 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.307479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55156 (local address 127.21.114.125:43639)
0812 16:42:28.309707 (+ 2228us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.309709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.311128 (+ 1419us) server_negotiation.cc:407] Connection header received
0812 16:42:28.311153 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.311154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.311166 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.311221 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.312903 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.313671 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.314777 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.315041 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.315110 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.317043 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.317044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.317044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.317052 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.318925 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.319294 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.319295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.319295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.319350 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.319556 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.319556 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.319557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.319650 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.319719 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.319875 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.319936 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2209,"thread_start_us":57,"threads_started":1}
I20260812 16:42:28.318027 1097 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:28.320360 1097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:28.321139 3580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: NON_VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: true } } }
I20260812 16:42:28.321244 3580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:28.322443 3581 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: attempting to promote NON_VOTER eeebd5bc41e846749bd61a04e5b9cf20 to VOTER
I20260812 16:42:28.322578 3581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } }
I20260812 16:42:28.322963 2281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Refusing update from remote peer 040f6bc8c526460195968f7952f6fe48: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 16:42:28.323030 2644 raft_consensus.cc:1261] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 LEARNER]: Refusing update from remote peer 040f6bc8c526460195968f7952f6fe48: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 16:42:28.323205 2559 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 16:42:28.323622 2559 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 16:42:28.323902 3580 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.324045 2281 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.324941 3580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.325027 3580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:28.325088 3580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.325160 3580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:28.325580 3581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.325668 3581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:28.325670 2639 raft_consensus.cc:2932] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.325847 3597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.325929 3597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:42:28.326748 2716 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "040f6bc8c526460195968f7952f6fe48" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:28.326831 2716 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:42:28.330513 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.326559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40326 (local address 127.21.114.67:40441)
0812 16:42:28.326808 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.326813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.326825 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:42:28.326866 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.326868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.326885 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.326976 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:28.327108 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.328190 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.329370 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.330143 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.330221 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.330298 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.330396 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.330433 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":106,"threads_started":1}
I20260812 16:42:28.330529 3599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.326216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:40441 (local address 127.0.0.1:40326)
0812 16:42:28.326415 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.326423 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.326462 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.326993 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.326994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.326996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:28.327042 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.327044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.328295 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.328296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.329272 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.329274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.330238 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.330239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.330308 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.330313 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.330383 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.330430 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":25,"thread_start_us":83,"threads_started":1}
I20260812 16:42:28.330540 3604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.326424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:40657 (local address 127.0.0.1:60436)
0812 16:42:28.326544 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.326556 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.326613 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.327418 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.327419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.327422 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:28.327468 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.327470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.328445 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.328446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.329370 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.329373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.330297 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.330297 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.330354 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.330358 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.330388 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.330430 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260812 16:42:28.331097 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.326216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:44513 (local address 127.0.0.1:50588)
0812 16:42:28.326280 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.326292 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.326333 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.327620 (+ 1287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.327620 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.327622 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:28.327660 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.327662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.328931 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.328932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.329934 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.329937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.330852 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.330853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.330921 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.330925 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.330993 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.331032 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":1}
I20260812 16:42:28.331444 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.327034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60436 (local address 127.21.114.65:40657)
0812 16:42:28.327212 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.327217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.327228 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:28.327270 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.327272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.327288 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.327550 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:28.327601 (+ 51us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.328286 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.329450 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.330179 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.331126 (+ 947us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.331323 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.331349 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.331385 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
I20260812 16:42:28.331434 3418 tablet_service.cc:1467] Processing CreateTablet for tablet 52bbeb5a5e894c43a6bb12b7fc737b17 (DEFAULT_TABLE table=test-table [id=ca4cf1d1a7624f339b837e5a95b9c5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:28.331807 3418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52bbeb5a5e894c43a6bb12b7fc737b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:28.332088 2857 tablet_service.cc:1467] Processing CreateTablet for tablet 52bbeb5a5e894c43a6bb12b7fc737b17 (DEFAULT_TABLE table=test-table [id=ca4cf1d1a7624f339b837e5a95b9c5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:28.332477 2857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52bbeb5a5e894c43a6bb12b7fc737b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:28.332597 3609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.326815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.21.114.66:44513)
0812 16:42:28.327452 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.327456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.327466 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:28.327503 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.327505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.327521 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.327723 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:28.327791 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.328836 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.330035 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.330764 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.330825 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.330902 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.331007 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.332515 (+ 1508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":129,"threads_started":1}
I20260812 16:42:28.334699 3611 tablet_bootstrap.cc:492] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Bootstrap starting.
I20260812 16:42:28.335063 3612 tablet_bootstrap.cc:492] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Bootstrap starting.
I20260812 16:42:28.335377 3611 tablet_bootstrap.cc:654] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:28.335701 3611 log.cc:824] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:28.335780 3612 tablet_bootstrap.cc:654] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:28.335736 3133 tablet_service.cc:1467] Processing CreateTablet for tablet 52bbeb5a5e894c43a6bb12b7fc737b17 (DEFAULT_TABLE table=test-table [id=ca4cf1d1a7624f339b837e5a95b9c5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:28.336102 3133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52bbeb5a5e894c43a6bb12b7fc737b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:28.336090 3612 log.cc:824] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:28.336652 3611 tablet_bootstrap.cc:492] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: No bootstrap required, opened a new log
I20260812 16:42:28.336742 3611 ts_tablet_manager.cc:1397] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:28.336887 3612 tablet_bootstrap.cc:492] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: No bootstrap required, opened a new log
I20260812 16:42:28.336961 3612 ts_tablet_manager.cc:1397] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:28.339380 3611 raft_consensus.cc:348] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.339538 3611 raft_consensus.cc:374] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:28.339581 3611 raft_consensus.cc:729] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2621d01d4a4b8b874dc2e246ccf9b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:28.339594 3612 raft_consensus.cc:348] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.339720 3611 consensus_queue.cc:260] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.339764 3612 raft_consensus.cc:374] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:28.339810 3612 raft_consensus.cc:729] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542efa7b07bd4248aad75cc8491cb7d6, State: Initialized, Role: FOLLOWER
I20260812 16:42:28.339919 3612 consensus_queue.cc:260] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.339953 3618 tablet_bootstrap.cc:492] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Bootstrap starting.
I20260812 16:42:28.340055 3611 ts_tablet_manager.cc:1428] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:42:28.340179 3539 heartbeater.cc:503] Master 127.21.114.126:35983 was elected leader, sending a full tablet report...
I20260812 16:42:28.340179 3612 ts_tablet_manager.cc:1428] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:42:28.340444 2991 heartbeater.cc:503] Master 127.21.114.126:35983 was elected leader, sending a full tablet report...
I20260812 16:42:28.340654 3618 tablet_bootstrap.cc:654] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:28.341014 3618 log.cc:824] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:28.342082 3618 tablet_bootstrap.cc:492] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: No bootstrap required, opened a new log
I20260812 16:42:28.342155 3618 ts_tablet_manager.cc:1397] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:28.344069 3618 raft_consensus.cc:348] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.344200 3618 raft_consensus.cc:374] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:28.344223 3618 raft_consensus.cc:729] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82ec7562b78e422fb9d9abd83afe052c, State: Initialized, Role: FOLLOWER
I20260812 16:42:28.344368 3618 consensus_queue.cc:260] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.344647 3618 ts_tablet_manager.cc:1428] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:28.344812 3281 heartbeater.cc:503] Master 127.21.114.126:35983 was elected leader, sending a full tablet report...
W20260812 16:42:28.384266 3284 tablet.cc:2369] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:28.405094 3620 raft_consensus.cc:482] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:28.405375 3620 raft_consensus.cc:504] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.405790 3620 leader_election.cc:288] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513), 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441)
I20260812 16:42:28.409838 3609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.406072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:37929 (local address 127.21.114.66:44513)
0812 16:42:28.406121 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.406123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.406159 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:42:28.406184 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.406185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.406195 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.406254 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:28.406477 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.407241 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.408827 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.409434 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.409517 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.409526 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.409727 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.409770 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:42:28.409853 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.406098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:42325 (local address 127.21.114.67:40441)
0812 16:42:28.406141 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.406143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.406150 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:42:28.406181 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.406182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.406193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.406254 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:28.406478 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.407255 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.408827 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.409435 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.409517 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.409526 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.409730 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.409795 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:42:28.409859 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.405983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:40441 (local address 127.21.114.65:42325)
0812 16:42:28.406043 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.406056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.406101 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.406277 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.406278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.406280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:28.406391 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.406393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.407354 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.407354 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.408717 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.408720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.409540 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.409542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.409630 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.409635 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.409699 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.409750 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":100}
I20260812 16:42:28.409860 3001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.405994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:44513 (local address 127.21.114.65:37929)
0812 16:42:28.406043 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:28.406056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:28.406101 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:28.406277 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:28.406278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:28.406280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:28.406391 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.406393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.407351 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.407353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.408717 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:28.408720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.409540 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.409542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:28.409630 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.409635 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:28.409699 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:42:28.409776 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":48}
I20260812 16:42:28.410308 3454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52bbeb5a5e894c43a6bb12b7fc737b17" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" is_pre_election: true
I20260812 16:42:28.410501 3454 raft_consensus.cc:2454] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 0.
I20260812 16:42:28.410523 3173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52bbeb5a5e894c43a6bb12b7fc737b17" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82ec7562b78e422fb9d9abd83afe052c" is_pre_election: true
I20260812 16:42:28.410705 3173 raft_consensus.cc:2454] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 0.
I20260812 16:42:28.410785 2775 leader_election.cc:302] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 542efa7b07bd4248aad75cc8491cb7d6, 8e2621d01d4a4b8b874dc2e246ccf9b0; no voters:
I20260812 16:42:28.410910 3620 raft_consensus.cc:2781] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:28.410964 3620 raft_consensus.cc:482] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:28.410992 3620 raft_consensus.cc:3037] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:28.411736 3620 raft_consensus.cc:504] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.411880 3620 leader_election.cc:288] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513), 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441)
I20260812 16:42:28.412024 3454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52bbeb5a5e894c43a6bb12b7fc737b17" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0"
I20260812 16:42:28.412024 3173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52bbeb5a5e894c43a6bb12b7fc737b17" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82ec7562b78e422fb9d9abd83afe052c"
I20260812 16:42:28.412101 3454 raft_consensus.cc:3037] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:28.412127 3173 raft_consensus.cc:3037] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:28.412955 3454 raft_consensus.cc:2454] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 1.
I20260812 16:42:28.412997 3173 raft_consensus.cc:2454] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 1.
I20260812 16:42:28.413123 2775 leader_election.cc:302] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 542efa7b07bd4248aad75cc8491cb7d6, 8e2621d01d4a4b8b874dc2e246ccf9b0; no voters:
I20260812 16:42:28.413230 3620 raft_consensus.cc:2781] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:28.413427 3620 raft_consensus.cc:686] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 LEADER]: Becoming Leader. State: Replica: 542efa7b07bd4248aad75cc8491cb7d6, State: Running, Role: LEADER
I20260812 16:42:28.413543 3620 consensus_queue.cc:237] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:28.414386 1096 catalog_manager.cc:5495] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "542efa7b07bd4248aad75cc8491cb7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:28.425516 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.423242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.21.114.65:40657)
0812 16:42:28.423285 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.423291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.423300 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:28.423355 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.423356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.423372 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.423435 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:28.423537 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.424001 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.424855 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.425054 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.425119 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.425252 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:28.425353 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:28.425425 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.425445 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.425462 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:28.427493 3173 raft_consensus.cc:1261] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Refusing update from remote peer 542efa7b07bd4248aad75cc8491cb7d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:28.427493 3454 raft_consensus.cc:1261] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Refusing update from remote peer 542efa7b07bd4248aad75cc8491cb7d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:28.427937 3627 consensus_queue.cc:1035] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:28.428077 3620 consensus_queue.cc:1035] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:28.431499 3647 mvcc.cc:205] Tried to move back new op lower bound from 7317720876755714048 to 7317720876702441472. Current Snapshot: MvccSnapshot[applied={T|T < 7317720876755714048 or (T in {7317720876755714048})}]
I20260812 16:42:28.432360 3648 mvcc.cc:205] Tried to move back new op lower bound from 7317720876755714048 to 7317720876702441472. Current Snapshot: MvccSnapshot[applied={T|T < 7317720876755714048}]
I20260812 16:42:28.433538 1097 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:28.433660 1097 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:28.434988 1097 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 040f6bc8c526460195968f7952f6fe48: Sending DeleteTablet for 3 replicas of tablet 52bbeb5a5e894c43a6bb12b7fc737b17
I20260812 16:42:28.435353 3133 tablet_service.cc:1514] Processing DeleteTablet for tablet 52bbeb5a5e894c43a6bb12b7fc737b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:28 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:50588
I20260812 16:42:28.435568 3658 tablet_replica.cc:330] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: stopping tablet replica
I20260812 16:42:28.435665 3658 raft_consensus.cc:2229] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:28.435758 3658 raft_consensus.cc:2258] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:28.435786 3418 tablet_service.cc:1514] Processing DeleteTablet for tablet 52bbeb5a5e894c43a6bb12b7fc737b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:28 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:40326
I20260812 16:42:28.435997 2857 tablet_service.cc:1514] Processing DeleteTablet for tablet 52bbeb5a5e894c43a6bb12b7fc737b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:28 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:60436
I20260812 16:42:28.436223 3658 ts_tablet_manager.cc:1905] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:28.436460 3663 tablet_replica.cc:330] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: stopping tablet replica
I20260812 16:42:28.436619 3665 tablet_replica.cc:330] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: stopping tablet replica
I20260812 16:42:28.436651 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 1047
I20260812 16:42:28.444703 3658 ts_tablet_manager.cc:1918] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:28.444797 3658 log.cc:1196] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/52bbeb5a5e894c43a6bb12b7fc737b17
I20260812 16:42:28.445040 3658 ts_tablet_manager.cc:1939] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 82ec7562b78e422fb9d9abd83afe052c: Deleting consensus metadata
I20260812 16:42:28.447631 3665 raft_consensus.cc:2229] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:28.447794 3665 raft_consensus.cc:2258] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:28.447988 3663 raft_consensus.cc:2229] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:28.448130 3663 raft_consensus.cc:2258] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:28.451292 3665 ts_tablet_manager.cc:1905] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:28.451292 3663 ts_tablet_manager.cc:1905] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:28.453460 3665 ts_tablet_manager.cc:1918] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:28.453562 3665 log.cc:1196] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/52bbeb5a5e894c43a6bb12b7fc737b17
I20260812 16:42:28.453747 3663 ts_tablet_manager.cc:1918] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:28.453867 3665 ts_tablet_manager.cc:1939] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 542efa7b07bd4248aad75cc8491cb7d6: Deleting consensus metadata
I20260812 16:42:28.453876 3663 log.cc:1196] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/52bbeb5a5e894c43a6bb12b7fc737b17
I20260812 16:42:28.454234 3663 ts_tablet_manager.cc:1939] T 52bbeb5a5e894c43a6bb12b7fc737b17 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Deleting consensus metadata
W20260812 16:42:28.457463 2775 connection.cc:535] server connection from 127.0.0.1:60436 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 16:42:28.457508 3326 connection.cc:535] server connection from 127.0.0.1:40326 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 16:42:28.457746 3042 connection.cc:535] server connection from 127.0.0.1:50588 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 16:42:28.465113 3565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.435909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48936 (local address 127.21.114.124:44451)
0812 16:42:28.435952 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.435955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.456574 (+ 20619us) server_negotiation.cc:407] Connection header received
0812 16:42:28.456639 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.456640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.456660 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.456729 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.457528 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.458364 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.459540 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.459868 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.459911 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.461615 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.461616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.461617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.461625 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.463503 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.463911 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.463913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.463913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.463983 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.464215 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.464216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.464217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.464488 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.464603 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.464829 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.464969 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:28.468277 3002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.459724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48952 (local address 127.21.114.124:44451)
0812 16:42:28.459780 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.459782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.460107 (+ 325us) server_negotiation.cc:407] Connection header received
0812 16:42:28.460179 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.460180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.460190 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.460251 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.460991 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.461450 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.462550 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.462854 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.462927 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.464808 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.464809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.464809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.464815 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.466534 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.466928 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.466929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.466929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.466991 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.467691 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.467692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.467692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.467824 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.467919 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.468107 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.468182 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 16:42:28.472014 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:28.459729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55168 (local address 127.21.114.125:43639)
0812 16:42:28.459780 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:28.459782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:28.464508 (+ 4726us) server_negotiation.cc:407] Connection header received
0812 16:42:28.464610 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:28.464611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:28.464628 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:28.464657 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:28.465567 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.466236 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.467222 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:28.467564 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:28.467635 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:28.469240 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:28.469242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:28.469242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:28.469250 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:28.470766 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.471160 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.471161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.471161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.471226 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:28.471475 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:28.471476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:28.471476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:28.471610 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:28.471709 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:28.471857 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 16:42:28.471952 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:29.432822 3676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.432178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:56257)
0812 16:42:29.432411 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.432758 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":78,"threads_started":1}
W20260812 16:42:29.433229 2991 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:35983 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.433243 3677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.432862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:45487)
0812 16:42:29.433120 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.433194 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":52,"threads_started":1}
W20260812 16:42:29.433611 3539 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:35983 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.433889 3679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.433543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.66:59385)
0812 16:42:29.433749 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.433845 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":78,"threads_started":1}
W20260812 16:42:29.434067 3281 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:35983 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.935402 3684 raft_consensus.cc:482] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 040f6bc8c526460195968f7952f6fe48)
I20260812 16:42:29.935544 3684 raft_consensus.cc:504] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } }
I20260812 16:42:29.935781 3684 leader_election.cc:288] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983), 92e6e80bfa4944e6b72d9aeb3bccf262 (127.21.114.125:43639)
I20260812 16:42:29.936041 3685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 040f6bc8c526460195968f7952f6fe48)
I20260812 16:42:29.936137 3685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } }
I20260812 16:42:29.936232 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.935975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35190)
0812 16:42:29.936103 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.936185 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":55,"threads_started":1}
W20260812 16:42:29.936605 2605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.936663 3688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.936435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35204)
0812 16:42:29.936552 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.936614 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260812 16:42:29.936851 3685 leader_election.cc:288] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983), eeebd5bc41e846749bd61a04e5b9cf20 (127.21.114.124:44451)
W20260812 16:42:29.936955 2244 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.937616 3698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.937411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35214)
0812 16:42:29.937546 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.937583 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":92,"threads_started":1}
I20260812 16:42:29.937619 3691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.937319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35206)
0812 16:42:29.937547 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.937586 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
W20260812 16:42:29.937736 2244 leader_election.cc:334] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983): Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
W20260812 16:42:29.938465 2605 leader_election.cc:334] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983): Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.939955 3687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.936195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55180 (local address 127.21.114.125:43639)
0812 16:42:29.936384 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:29.936386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:29.936447 (+ 61us) server_negotiation.cc:407] Connection header received
0812 16:42:29.936533 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:29.936534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:29.936549 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:29.936819 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:29.936860 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.937673 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.939002 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.939588 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.939661 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.939670 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:29.939840 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 16:42:29.939911 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":60,"threads_started":1}
I20260812 16:42:29.939946 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.936296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:43639 (local address 127.0.0.1:55180)
0812 16:42:29.936362 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.936374 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:29.936445 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:29.936674 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:29.936676 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:29.936680 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:29.936751 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.936753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.937755 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.937756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.938919 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.938922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.939673 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.939674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.939732 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.939736 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:29.939827 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 16:42:29.939877 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":5}
I20260812 16:42:29.940286 2281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" is_pre_election: true
I20260812 16:42:29.940434 2281 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeebd5bc41e846749bd61a04e5b9cf20 in term 1.
I20260812 16:42:29.940587 2605 leader_election.cc:302] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e6e80bfa4944e6b72d9aeb3bccf262, eeebd5bc41e846749bd61a04e5b9cf20; no voters: 040f6bc8c526460195968f7952f6fe48
I20260812 16:42:29.940729 3684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 16:42:29.940776 3688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.936644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:44451 (local address 127.0.0.1:48962)
0812 16:42:29.937190 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.937200 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:29.937393 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:29.937596 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:29.937597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:29.937600 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:29.937647 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.937649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.938642 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.938642 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.939734 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.939736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.940467 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.940468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.940603 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.940606 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:29.940646 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 16:42:29.940701 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":52,"threads_started":1}
I20260812 16:42:29.940842 3694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.936872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48962 (local address 127.21.114.124:44451)
0812 16:42:29.937000 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:29.937002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:29.937285 (+ 283us) server_negotiation.cc:407] Connection header received
0812 16:42:29.937469 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:29.937470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:29.937483 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:29.937714 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:29.937759 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.938572 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.939817 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.940377 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.940458 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.940467 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:29.940671 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 16:42:29.940716 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":113,"thread_start_us":48,"threads_started":1}
I20260812 16:42:29.940795 3684 raft_consensus.cc:482] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 040f6bc8c526460195968f7952f6fe48)
I20260812 16:42:29.941042 3684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:42:29.941071 2639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" is_pre_election: true
I20260812 16:42:29.941819 3684 raft_consensus.cc:504] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } }
I20260812 16:42:29.941982 3684 leader_election.cc:288] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [CANDIDATE]: Term 2 election: Requested vote from peers 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983), 92e6e80bfa4944e6b72d9aeb3bccf262 (127.21.114.125:43639)
I20260812 16:42:29.942022 2639 raft_consensus.cc:2379] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92e6e80bfa4944e6b72d9aeb3bccf262 in current term 2: Already voted for candidate eeebd5bc41e846749bd61a04e5b9cf20 in this term.
I20260812 16:42:29.942189 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.942071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35226)
0812 16:42:29.942129 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.942165 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 16:42:29.942210 2281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262"
I20260812 16:42:29.942221 2242 leader_election.cc:302] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e6e80bfa4944e6b72d9aeb3bccf262; no voters: 040f6bc8c526460195968f7952f6fe48, eeebd5bc41e846749bd61a04e5b9cf20
I20260812 16:42:29.942312 2281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:42:29.942600 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.942480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35242)
0812 16:42:29.942533 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.942573 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 16:42:29.942689 2605 leader_election.cc:334] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983): Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
I20260812 16:42:29.943171 2281 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeebd5bc41e846749bd61a04e5b9cf20 in term 2.
I20260812 16:42:29.943277 3685 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:42:29.943359 2605 leader_election.cc:302] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e6e80bfa4944e6b72d9aeb3bccf262, eeebd5bc41e846749bd61a04e5b9cf20; no voters: 040f6bc8c526460195968f7952f6fe48
I20260812 16:42:29.943467 3684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 16:42:29.943598 3684 raft_consensus.cc:686] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [term 2 LEADER]: Becoming Leader. State: Replica: eeebd5bc41e846749bd61a04e5b9cf20, State: Running, Role: LEADER
I20260812 16:42:29.943678 3684 consensus_queue.cc:237] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } }
I20260812 16:42:29.944052 3700 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eeebd5bc41e846749bd61a04e5b9cf20. Latest consensus state: current_term: 2 leader_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:29.944156 3700 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:29.944416 3702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:29.944797 3702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:29.944926 3702 catalog_manager.cc:1259] Loaded cluster ID: 88c1d85c70264f50a1b00c579dd84733
I20260812 16:42:29.944959 3702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:29.945119 3702 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:29.945233 3702 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Loaded TSK: 0
I20260812 16:42:29.945405 3702 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:29.954246 2627 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:29.955819 2627 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:29.956872 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.956732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35250)
0812 16:42:29.956804 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.956839 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 16:42:29.956969 2281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [term 2 FOLLOWER]: Refusing update from remote peer eeebd5bc41e846749bd61a04e5b9cf20: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 16:42:29.957186 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.957073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.0.0.1:35254)
0812 16:42:29.957108 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.957159 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 16:42:29.957247 2605 consensus_peers.cc:487] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 -> Peer 040f6bc8c526460195968f7952f6fe48 (127.21.114.126:35983): Couldn't send request to peer 040f6bc8c526460195968f7952f6fe48. Status: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 16:42:29.957279 3684 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 16:42:29.957904 3685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eeebd5bc41e846749bd61a04e5b9cf20. Latest consensus state: current_term: 2 leader_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:29.958024 3685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:42:29.958518 3684 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:29.958614 3684 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:29.958729 3685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "040f6bc8c526460195968f7952f6fe48" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35983 } } peers { permanent_uuid: "92e6e80bfa4944e6b72d9aeb3bccf262" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 43639 } attrs { promote: false } } peers { permanent_uuid: "eeebd5bc41e846749bd61a04e5b9cf20" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 44451 } attrs { promote: false } } }
I20260812 16:42:29.958824 3685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92e6e80bfa4944e6b72d9aeb3bccf262 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:42:29.959013 3708 mvcc.cc:205] Tried to move back new op lower bound from 7317720883021484032 to 7317720882970083328. Current Snapshot: MvccSnapshot[applied={T|T < 7317720883021484032}]
I20260812 16:42:29.963577 3713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.960248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:40441 (local address 127.0.0.1:40338)
0812 16:42:29.960542 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.960550 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:29.960588 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:29.960983 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:29.960984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:29.960987 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:29.961032 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.961034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.961922 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.961923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.962718 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.962720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.963318 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.963319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.963380 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.963384 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:29.963453 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 16:42:29.963500 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":28}
I20260812 16:42:29.963757 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.960248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:44513 (local address 127.0.0.1:50604)
0812 16:42:29.960371 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.960382 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:29.960422 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:29.960680 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:29.960681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:29.960682 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:29.960727 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.960728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.961688 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.961689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.962787 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.962789 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.963559 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.963560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.963622 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.963626 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:29.963653 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 16:42:29.963693 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260812 16:42:29.963598 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.960701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40338 (local address 127.21.114.67:40441)
0812 16:42:29.960817 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:29.960820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:29.960829 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:29.960856 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:29.960857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:29.960868 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:29.960928 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:29.961142 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.961838 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.962822 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.963214 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.963298 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.963313 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:29.963480 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 16:42:29.963526 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":69,"threads_started":1}
I20260812 16:42:29.964020 3712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.960411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.21.114.66:44513)
0812 16:42:29.960542 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:29.960544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:29.960554 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:29.960582 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:29.960583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:29.960595 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:29.960678 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:29.960801 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.961601 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.962887 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.963466 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.963871 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.963890 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:29.963914 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 16:42:29.963957 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260812 16:42:29.964020 3418 tablet_service.cc:1467] Processing CreateTablet for tablet d3a94dcc5fc14a5c9b4cc82d421abd81 (DEFAULT_TABLE table=test-table [id=2d3f91033d564fb598ad181fdc2ac67b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:29.964162 3418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3a94dcc5fc14a5c9b4cc82d421abd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:29.964246 3133 tablet_service.cc:1467] Processing CreateTablet for tablet d3a94dcc5fc14a5c9b4cc82d421abd81 (DEFAULT_TABLE table=test-table [id=2d3f91033d564fb598ad181fdc2ac67b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:29.964404 3133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3a94dcc5fc14a5c9b4cc82d421abd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:29.965335 3717 tablet_bootstrap.cc:492] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Bootstrap starting.
I20260812 16:42:29.965657 3698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.960426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:40657 (local address 127.0.0.1:60458)
0812 16:42:29.960539 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.960548 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:29.960598 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:29.961231 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:29.961232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:29.961234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:29.961287 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.961289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.962139 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.962140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.963202 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:29.963205 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.965470 (+ 2265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.965471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:29.965554 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.965557 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:29.965582 (+ 25us) client_negotiation.cc:240] Negotiation successful
0812 16:42:29.965612 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":76,"threads_started":1}
I20260812 16:42:29.965930 3717 tablet_bootstrap.cc:654] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:29.965960 3716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.960881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60458 (local address 127.21.114.65:40657)
0812 16:42:29.961108 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:29.961111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:29.961119 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:29.961144 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:29.961145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:29.961155 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:29.961217 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:29.961381 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.962037 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.963320 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:29.965379 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:29.965785 (+ 406us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:29.965801 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:29.965821 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 16:42:29.965885 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":56,"threads_started":1}
I20260812 16:42:29.966179 2857 tablet_service.cc:1467] Processing CreateTablet for tablet d3a94dcc5fc14a5c9b4cc82d421abd81 (DEFAULT_TABLE table=test-table [id=2d3f91033d564fb598ad181fdc2ac67b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:29.966229 3718 tablet_bootstrap.cc:492] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Bootstrap starting.
I20260812 16:42:29.966313 2857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3a94dcc5fc14a5c9b4cc82d421abd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:29.966576 3717 tablet_bootstrap.cc:492] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: No bootstrap required, opened a new log
I20260812 16:42:29.966629 3717 ts_tablet_manager.cc:1397] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:29.966744 3717 raft_consensus.cc:348] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:29.966809 3717 raft_consensus.cc:374] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:29.966830 3717 raft_consensus.cc:729] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2621d01d4a4b8b874dc2e246ccf9b0, State: Initialized, Role: FOLLOWER
I20260812 16:42:29.966869 3717 consensus_queue.cc:260] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:29.967022 3717 ts_tablet_manager.cc:1428] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:29.967432 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.967184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:39375)
0812 16:42:29.967330 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.967380 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":105,"threads_started":1}
I20260812 16:42:29.967605 3538 heartbeater.cc:503] Master 127.21.114.124:44451 was elected leader, sending a full tablet report...
I20260812 16:42:29.967844 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.967757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:60021)
0812 16:42:29.967790 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.967816 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260812 16:42:29.967964 3734 tablet_bootstrap.cc:492] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6: Bootstrap starting.
I20260812 16:42:29.968408 3734 tablet_bootstrap.cc:654] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:29.968552 3718 tablet_bootstrap.cc:654] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:29.968961 3734 tablet_bootstrap.cc:492] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6: No bootstrap required, opened a new log
I20260812 16:42:29.969003 3734 ts_tablet_manager.cc:1397] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:29.969080 3734 raft_consensus.cc:348] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:29.969127 3734 raft_consensus.cc:374] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:29.969141 3734 raft_consensus.cc:729] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542efa7b07bd4248aad75cc8491cb7d6, State: Initialized, Role: FOLLOWER
I20260812 16:42:29.969198 3734 consensus_queue.cc:260] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:29.969363 3734 ts_tablet_manager.cc:1428] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:29.969767 2989 heartbeater.cc:503] Master 127.21.114.124:44451 was elected leader, sending a full tablet report...
I20260812 16:42:29.969880 3718 tablet_bootstrap.cc:492] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: No bootstrap required, opened a new log
I20260812 16:42:29.969935 3718 ts_tablet_manager.cc:1397] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 16:42:29.969967 3739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.969511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:39121)
0812 16:42:29.969639 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.969934 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":85,"threads_started":1}
I20260812 16:42:29.970059 3718 raft_consensus.cc:348] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:29.970145 3718 raft_consensus.cc:374] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:29.970484 3718 raft_consensus.cc:729] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82ec7562b78e422fb9d9abd83afe052c, State: Initialized, Role: FOLLOWER
I20260812 16:42:29.970520 3739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.970443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:52733)
0812 16:42:29.970478 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.970503 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260812 16:42:29.970629 3718 consensus_queue.cc:260] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:29.970820 3718 ts_tablet_manager.cc:1428] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:29.971333 3280 heartbeater.cc:503] Master 127.21.114.124:44451 was elected leader, sending a full tablet report...
I20260812 16:42:29.971568 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:29.970996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.66:49761)
0812 16:42:29.971422 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:29.971459 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":103,"threads_started":1}
W20260812 16:42:29.973543 2997 tablet.cc:2369] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:42:30.048646 3542 tablet.cc:2369] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:30.201027 3738 raft_consensus.cc:482] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:30.201170 3738 raft_consensus.cc:504] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:30.201401 3738 leader_election.cc:288] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441), 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513)
I20260812 16:42:30.201830 3173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3a94dcc5fc14a5c9b4cc82d421abd81" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82ec7562b78e422fb9d9abd83afe052c" is_pre_election: true
I20260812 16:42:30.201853 3454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3a94dcc5fc14a5c9b4cc82d421abd81" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" is_pre_election: true
I20260812 16:42:30.201958 3454 raft_consensus.cc:2454] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 0.
I20260812 16:42:30.201960 3173 raft_consensus.cc:2454] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 0.
I20260812 16:42:30.202145 2776 leader_election.cc:302] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 542efa7b07bd4248aad75cc8491cb7d6, 82ec7562b78e422fb9d9abd83afe052c; no voters:
I20260812 16:42:30.202291 3738 raft_consensus.cc:2781] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:30.202320 3738 raft_consensus.cc:482] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:30.202334 3738 raft_consensus.cc:3037] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:30.203070 3738 raft_consensus.cc:504] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:30.203218 3738 leader_election.cc:288] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441), 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513)
I20260812 16:42:30.203370 3454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3a94dcc5fc14a5c9b4cc82d421abd81" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0"
I20260812 16:42:30.203424 3173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3a94dcc5fc14a5c9b4cc82d421abd81" candidate_uuid: "542efa7b07bd4248aad75cc8491cb7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82ec7562b78e422fb9d9abd83afe052c"
I20260812 16:42:30.203478 3454 raft_consensus.cc:3037] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:30.203524 3173 raft_consensus.cc:3037] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:30.204185 3454 raft_consensus.cc:2454] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 1.
I20260812 16:42:30.204267 3173 raft_consensus.cc:2454] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 542efa7b07bd4248aad75cc8491cb7d6 in term 1.
I20260812 16:42:30.204421 2775 leader_election.cc:302] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 542efa7b07bd4248aad75cc8491cb7d6, 8e2621d01d4a4b8b874dc2e246ccf9b0; no voters:
I20260812 16:42:30.204538 3738 raft_consensus.cc:2781] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:30.204711 3738 raft_consensus.cc:686] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [term 1 LEADER]: Becoming Leader. State: Replica: 542efa7b07bd4248aad75cc8491cb7d6, State: Running, Role: LEADER
I20260812 16:42:30.204759 3738 consensus_queue.cc:237] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } }
I20260812 16:42:30.205286 3739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.205113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:42263)
0812 16:42:30.205212 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.205251 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 16:42:30.205555 2626 catalog_manager.cc:5495] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "542efa7b07bd4248aad75cc8491cb7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "542efa7b07bd4248aad75cc8491cb7d6" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40657 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:30.246348 3716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.244268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60464 (local address 127.21.114.65:40657)
0812 16:42:30.244343 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:30.244345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:30.244355 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:30.244389 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:30.244389 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:30.244399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:30.244450 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:30.244580 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:30.245073 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:30.245777 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:30.245980 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:30.246032 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:30.246152 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:30.246179 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:30.246218 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:30.246268 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 16:42:30.246288 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 16:42:30.247359 3173 raft_consensus.cc:1261] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Refusing update from remote peer 542efa7b07bd4248aad75cc8491cb7d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:30.247380 3454 raft_consensus.cc:1261] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Refusing update from remote peer 542efa7b07bd4248aad75cc8491cb7d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:30.247695 3749 consensus_queue.cc:1035] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82ec7562b78e422fb9d9abd83afe052c" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 44513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:30.247834 3738 consensus_queue.cc:1035] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 542efa7b07bd4248aad75cc8491cb7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2621d01d4a4b8b874dc2e246ccf9b0" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:30.248667 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.248542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.66:40385)
0812 16:42:30.248583 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.248628 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 16:42:30.248790 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.248683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:49373)
0812 16:42:30.248732 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.248758 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 16:42:30.250025 3739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.249923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:51473)
0812 16:42:30.249966 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.249993 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 16:42:30.250329 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.249820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.66:57765)
0812 16:42:30.250263 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.250296 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425}
I20260812 16:42:30.250767 3739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.250469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.65:50325)
0812 16:42:30.250705 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.250736 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220}
I20260812 16:42:30.250854 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:30.250767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35983 (local address 127.21.114.67:50951)
0812 16:42:30.250799 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.250826 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 16:42:30.251546 2626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:30.251648 2626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:30.253077 2626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eeebd5bc41e846749bd61a04e5b9cf20: Sending DeleteTablet for 3 replicas of tablet d3a94dcc5fc14a5c9b4cc82d421abd81
I20260812 16:42:30.253358 3418 tablet_service.cc:1514] Processing DeleteTablet for tablet d3a94dcc5fc14a5c9b4cc82d421abd81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:30 UTC) from {username='oryx', principal='oryx/127.21.114.124@KRBTEST.COM'} at 127.0.0.1:40338
I20260812 16:42:30.253386 3133 tablet_service.cc:1514] Processing DeleteTablet for tablet d3a94dcc5fc14a5c9b4cc82d421abd81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:30 UTC) from {username='oryx', principal='oryx/127.21.114.124@KRBTEST.COM'} at 127.0.0.1:50604
I20260812 16:42:30.253407 2857 tablet_service.cc:1514] Processing DeleteTablet for tablet d3a94dcc5fc14a5c9b4cc82d421abd81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:30 UTC) from {username='oryx', principal='oryx/127.21.114.124@KRBTEST.COM'} at 127.0.0.1:60458
I20260812 16:42:30.253583 3780 tablet_replica.cc:330] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: stopping tablet replica
I20260812 16:42:30.253647 3780 raft_consensus.cc:2229] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:30.253700 3780 raft_consensus.cc:2258] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:30.253803 3781 tablet_replica.cc:330] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: stopping tablet replica
I20260812 16:42:30.253870 3781 raft_consensus.cc:2229] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:30.253916 3781 raft_consensus.cc:2258] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:30.253919 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 2548
I20260812 16:42:30.254015 3780 ts_tablet_manager.cc:1905] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:30.257306 3780 ts_tablet_manager.cc:1918] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:30.257380 3780 log.cc:1196] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/d3a94dcc5fc14a5c9b4cc82d421abd81
I20260812 16:42:30.257666 3780 ts_tablet_manager.cc:1939] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 8e2621d01d4a4b8b874dc2e246ccf9b0: Deleting consensus metadata
I20260812 16:42:30.257885 3781 ts_tablet_manager.cc:1905] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:30.257959 2598 catalog_manager.cc:4841] TS 8e2621d01d4a4b8b874dc2e246ccf9b0 (127.21.114.67:40441): tablet d3a94dcc5fc14a5c9b4cc82d421abd81 (table test-table [id=2d3f91033d564fb598ad181fdc2ac67b]) successfully deleted
I20260812 16:42:30.259163 3781 ts_tablet_manager.cc:1918] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:30.259248 3781 log.cc:1196] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/d3a94dcc5fc14a5c9b4cc82d421abd81
I20260812 16:42:30.259472 3781 ts_tablet_manager.cc:1939] T d3a94dcc5fc14a5c9b4cc82d421abd81 P 82ec7562b78e422fb9d9abd83afe052c: Deleting consensus metadata
I20260812 16:42:30.266716 2602 catalog_manager.cc:4841] TS 82ec7562b78e422fb9d9abd83afe052c (127.21.114.66:44513): tablet d3a94dcc5fc14a5c9b4cc82d421abd81 (table test-table [id=2d3f91033d564fb598ad181fdc2ac67b]) successfully deleted
W20260812 16:42:30.274376 3698 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:30.274239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:40657 (local address 127.0.0.1:60480)
0812 16:42:30.274286 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:30.274323 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:40657: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":20}
W20260812 16:42:30.274562 2598 catalog_manager.cc:4584] TS 542efa7b07bd4248aad75cc8491cb7d6 (127.21.114.65:40657): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d3a94dcc5fc14a5c9b4cc82d421abd81: Network error: Client connection negotiation failed: client connection to 127.21.114.65:40657: connect: Connection reset by peer (error 104)
I20260812 16:42:30.274606 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 3015
I20260812 16:42:30.291333 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 3292
I20260812 16:42:30.303673 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 1995
I20260812 16:42:30.316566 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 2367
2026-08-12T16:42:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5170 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:30 dist-test-slave-45dx krb5kdc[3787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:30 dist-test-slave-45dx krb5kdc[3787](info): set up 2 sockets
Aug 12 16:42:30 dist-test-slave-45dx krb5kdc[3787](info): commencing operation
krb5kdc: starting...
W20260812 16:42:31.725997 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.380s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:31 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:31Z Disabled control of system clock
WARNING: no policy specified for oryx/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab.
Entry for principal oryx/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab.
I20260812 16:42:31.849247 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33445
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab
--principal=oryx/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:31.932385 3815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:31.932650 3815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:31.932698 3815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:31.933853 3815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:31.933928 3815 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 16:42:31.933952 3815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:31.933974 3815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:31.934005 3815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:31.934026 3815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:31.935523 3815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33445
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.126.keytab
--principal=oryx/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:31.935808 3815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:31.936043 3815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:31.941092 3824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:31.941159 3823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:31.941108 3832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:31.941430 3815 server_base.cc:1034] running on GCE node
I20260812 16:42:31.941684 3815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:31.941951 3815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:31.943097 3815 hybrid_clock.cc:648] HybridClock initialized: now 1786552951943076 us; error 38 us; skew 500 ppm
Aug 12 16:42:31 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552951, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:31.949828 3815 init.cc:377] Logged in from keytab as oryx/127.21.114.126@KRBTEST.COM (short username oryx)
I20260812 16:42:31.950312 3815 webserver.cc:460] Webserver started at http://127.21.114.126:41463/ using document root <none> and password file <none>
I20260812 16:42:31.950546 3815 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:31.950618 3815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:31.950776 3815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:31.951901 3815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "a16650a6422048288c8c1987c025529b"
format_stamp: "Formatted at 2026-08-12 16:42:31 on dist-test-slave-45dx"
server_key: "f3d4aefbd9aceed9ac5d1b182515deb7"
server_key_iv: "4b1adb12c4bccffd94612efb75502228"
server_key_version: "encryptionkey@0"
I20260812 16:42:31.952280 3815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "a16650a6422048288c8c1987c025529b"
format_stamp: "Formatted at 2026-08-12 16:42:31 on dist-test-slave-45dx"
server_key: "f3d4aefbd9aceed9ac5d1b182515deb7"
server_key_iv: "4b1adb12c4bccffd94612efb75502228"
server_key_version: "encryptionkey@0"
I20260812 16:42:31.953717 3815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:31.954526 3845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:31.954710 3815 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:31.954816 3815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "a16650a6422048288c8c1987c025529b"
format_stamp: "Formatted at 2026-08-12 16:42:31 on dist-test-slave-45dx"
server_key: "f3d4aefbd9aceed9ac5d1b182515deb7"
server_key_iv: "4b1adb12c4bccffd94612efb75502228"
server_key_version: "encryptionkey@0"
I20260812 16:42:31.954912 3815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:31.983497 3815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:31.986020 3815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:31.986197 3815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:31.991101 3815 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33445
I20260812 16:42:31.991153 3966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33445 every 8 connection(s)
I20260812 16:42:31.991489 3815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:31.992172 3969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:31.994472 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 3815
I20260812 16:42:31.994587 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:31.994818 21961 external_mini_cluster.cc:1428] Setting key d9fe84d1f386c4f3867731320f3ff49d
I20260812 16:42:31.994931 3969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Bootstrap starting.
I20260812 16:42:31.995749 3969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:31.996104 3969 log.cc:824] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:31.996948 3969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: No bootstrap required, opened a new log
I20260812 16:42:31.999325 3969 raft_consensus.cc:348] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a16650a6422048288c8c1987c025529b" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33445 } }
I20260812 16:42:31.999501 3969 raft_consensus.cc:374] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:31.999539 3969 raft_consensus.cc:729] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a16650a6422048288c8c1987c025529b, State: Initialized, Role: FOLLOWER
I20260812 16:42:31.999660 3969 consensus_queue.cc:260] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a16650a6422048288c8c1987c025529b" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33445 } }
I20260812 16:42:31.999730 3969 raft_consensus.cc:388] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:31.999766 3969 raft_consensus.cc:482] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:31.999814 3969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.000528 3969 raft_consensus.cc:504] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a16650a6422048288c8c1987c025529b" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33445 } }
I20260812 16:42:32.000656 3969 leader_election.cc:302] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a16650a6422048288c8c1987c025529b; no voters:
I20260812 16:42:32.000823 3969 leader_election.cc:288] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:32.000896 3978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:32.001106 3969 sys_catalog.cc:564] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:32.001096 3978 raft_consensus.cc:686] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [term 1 LEADER]: Becoming Leader. State: Replica: a16650a6422048288c8c1987c025529b, State: Running, Role: LEADER
I20260812 16:42:32.001577 3978 consensus_queue.cc:237] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a16650a6422048288c8c1987c025529b" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33445 } }
I20260812 16:42:32.001965 3983 sys_catalog.cc:455] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a16650a6422048288c8c1987c025529b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a16650a6422048288c8c1987c025529b" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33445 } } }
I20260812 16:42:32.001983 3984 sys_catalog.cc:455] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a16650a6422048288c8c1987c025529b. Latest consensus state: current_term: 1 leader_uuid: "a16650a6422048288c8c1987c025529b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a16650a6422048288c8c1987c025529b" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33445 } } }
I20260812 16:42:32.002061 3983 sys_catalog.cc:458] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:32.002094 3984 sys_catalog.cc:458] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:32.002300 4000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 16:42:31 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:32.002862 4000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:32.004812 4000 catalog_manager.cc:1347] Generated new cluster ID: e3d18385041f4d8cb46a6e98ce7061a8
I20260812 16:42:32.004866 4000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:32.007403 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:31.995345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39086 (local address 127.21.114.126:33445)
0812 16:42:31.995556 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:31.995565 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:31.995600 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:42:31.996210 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:31.996219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:31.996289 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:31.996461 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:31.997241 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:31.998715 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:31.999463 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.000091 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.000197 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.003244 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.003248 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.003249 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.003262 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.005348 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.005769 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.005772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.005772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.005882 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.006107 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.006107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.006108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.006388 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.006530 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.006948 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.007116 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":103,"threads_started":1}
I20260812 16:42:32.028445 4000 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:32.029048 4000 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:32.031793 4000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Generated new TSK 0
I20260812 16:42:32.032002 4000 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab.
Entry for principal oryx/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab.
I20260812 16:42:32.064253 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33445
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:32.148164 4024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:32.148401 4024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:32.148427 4024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:32.149652 4024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:32.149694 4024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:32.149715 4024 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:32.149775 4024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:32.151291 4024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:32.151549 4024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:32.151793 4024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:32.156889 4042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:32.156924 4040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:32.156862 4039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:32.157148 4024 server_base.cc:1034] running on GCE node
I20260812 16:42:32.157383 4024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:32.157640 4024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:32.158778 4024 hybrid_clock.cc:648] HybridClock initialized: now 1786552952158761 us; error 32 us; skew 500 ppm
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:32.161578 4024 init.cc:377] Logged in from keytab as oryx/127.21.114.65@KRBTEST.COM (short username oryx)
I20260812 16:42:32.162036 4024 webserver.cc:460] Webserver started at http://127.21.114.65:34645/ using document root <none> and password file <none>
I20260812 16:42:32.162288 4024 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:32.162359 4024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:32.162508 4024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:32.163539 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "8b291bf116604e228f0b3620ac2ddb15"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "771092533c6264b8a3b18b87aa62bc38"
server_key_iv: "2264f039f10c5078bb61d679a2bd2330"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.163919 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "8b291bf116604e228f0b3620ac2ddb15"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "771092533c6264b8a3b18b87aa62bc38"
server_key_iv: "2264f039f10c5078bb61d679a2bd2330"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.165349 4024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:32.166079 4052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.166370 4024 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:42:32.166483 4024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "8b291bf116604e228f0b3620ac2ddb15"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "771092533c6264b8a3b18b87aa62bc38"
server_key_iv: "2264f039f10c5078bb61d679a2bd2330"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.166558 4024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:32.175220 4024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:32.177635 4024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:32.177801 4024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:32.178305 4024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:32.178367 4024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.178408 4024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:32.178436 4024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.185503 4024 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:43833
I20260812 16:42:32.185534 4280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:43833 every 8 connection(s)
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:32.185925 4024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:32.189191 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.178795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:47069 (local address 127.21.114.126:33445)
0812 16:42:32.178860 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.178862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.179075 (+ 213us) server_negotiation.cc:407] Connection header received
0812 16:42:32.179662 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.179664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.179679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.179764 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.180643 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.181515 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.183102 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.183454 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.183526 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.186350 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.186352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.186352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.186361 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.187690 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.188081 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.188082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.188082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.188136 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.188520 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.188521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.188521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.188650 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.188718 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.189041 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.189124 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:32.189391 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.178796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.21.114.65:47069)
0812 16:42:32.178961 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.178996 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.179542 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.179830 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.179833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.180222 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.180534 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.180541 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.181622 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.181624 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.183024 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.183028 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.183535 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.183536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.183671 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.184220 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.184232 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.186233 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.187773 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.187783 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.187786 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.188010 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.188237 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.188238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.188238 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.188440 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.188749 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.188756 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.188899 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.189000 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.189140 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260812 16:42:32.189831 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 4024
I20260812 16:42:32.189961 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:32.190099 4281 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33445
I20260812 16:42:32.190204 4281 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:32.190214 21961 external_mini_cluster.cc:1428] Setting key 5d3ab87916484e92899ba1ad80489612
I20260812 16:42:32.190426 4281 heartbeater.cc:511] Master 127.21.114.126:33445 requested a full tablet report, sending...
I20260812 16:42:32.191350 3878 ts_manager.cc:194] Registered new tserver with Master: 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833)
I20260812 16:42:32.192435 3878 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:47069
I20260812 16:42:32.197469 4291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.191189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.21.114.65:34895)
0812 16:42:32.191320 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.191337 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.191416 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.191536 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.191537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.191715 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.191765 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.191767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.192479 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.192480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.193393 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.193397 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.193837 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.193839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.193913 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.194359 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.194365 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.194761 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.196409 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.196410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.196411 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.196584 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.196803 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.196803 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.196804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.196879 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.197239 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.197239 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.197276 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.197335 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.197406 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260812 16:42:32.197597 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.191238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:34895 (local address 127.21.114.126:33445)
0812 16:42:32.191274 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.191276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.191404 (+ 128us) server_negotiation.cc:407] Connection header received
0812 16:42:32.191474 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.191475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.191485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.191535 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.191844 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.192365 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.193499 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.193735 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.193811 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.194853 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.194854 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.194855 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.194861 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.196275 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.196660 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.196661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.196662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.196720 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.196973 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.196975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.196976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.197150 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.197250 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.197392 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.197488 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for oryx/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab.
Entry for principal oryx/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab.
I20260812 16:42:32.219945 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33445
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:32.306300 4299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:32.306499 4299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:32.306521 4299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:32.307633 4299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:32.307670 4299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:32.307690 4299 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:32.307708 4299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:32.309170 4299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:32.309367 4299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:32.309531 4299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:32.314576 4313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:32.314605 4308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:32.314630 4299 server_base.cc:1034] running on GCE node
W20260812 16:42:32.314767 4307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:32.315055 4299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:32.315353 4299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:32.316499 4299 hybrid_clock.cc:648] HybridClock initialized: now 1786552952316472 us; error 37 us; skew 500 ppm
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:32.319075 4299 init.cc:377] Logged in from keytab as oryx/127.21.114.66@KRBTEST.COM (short username oryx)
I20260812 16:42:32.319466 4299 webserver.cc:460] Webserver started at http://127.21.114.66:40709/ using document root <none> and password file <none>
I20260812 16:42:32.319711 4299 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:32.319782 4299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:32.319944 4299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:32.321053 4299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "03f88e33b83546da8628ea9b37b0c4f9"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "96b1506f644333cd7f7eb2d5680587b3"
server_key_iv: "769ab671c0516d197b1cbc2ca8d523a3"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.321429 4299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "03f88e33b83546da8628ea9b37b0c4f9"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "96b1506f644333cd7f7eb2d5680587b3"
server_key_iv: "769ab671c0516d197b1cbc2ca8d523a3"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.322777 4299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:42:32.323503 4322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.323678 4299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:32.323791 4299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "03f88e33b83546da8628ea9b37b0c4f9"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "96b1506f644333cd7f7eb2d5680587b3"
server_key_iv: "769ab671c0516d197b1cbc2ca8d523a3"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.323866 4299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:32.335064 4299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:32.337106 4299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:32.337276 4299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:32.337864 4299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:32.337929 4299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.337970 4299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:32.337999 4299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:32.345626 4299 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:34941
I20260812 16:42:32.345728 4538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:34941 every 8 connection(s)
I20260812 16:42:32.346029 4299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:32.349071 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.338375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:45473 (local address 127.21.114.126:33445)
0812 16:42:32.338446 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.338449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.338706 (+ 257us) server_negotiation.cc:407] Connection header received
0812 16:42:32.339432 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.339433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.339444 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.339489 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.340416 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.341301 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.343028 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.343346 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.343403 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.346184 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.346186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.346186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.346193 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.347764 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.348165 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.348166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.348167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.348220 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.348535 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.348535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.348536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.348642 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.348698 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.348941 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.349006 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:42:32.349212 4332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.338347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.21.114.66:45473)
0812 16:42:32.338555 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.338606 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.339324 (+ 718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.339568 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.339573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.340001 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.340324 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.340331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.341406 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.341408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.342929 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.342934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.343439 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.343441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.343620 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.344184 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.344194 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.346065 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.347860 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.347866 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.347868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.348093 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.348281 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.348281 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.348282 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.348474 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.348704 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.348709 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.348821 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.348899 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.349020 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":105,"threads_started":1}
I20260812 16:42:32.349691 4539 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33445
I20260812 16:42:32.349781 4539 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:32.349972 4539 heartbeater.cc:511] Master 127.21.114.126:33445 requested a full tablet report, sending...
I20260812 16:42:32.350360 3880 ts_manager.cc:194] Registered new tserver with Master: 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:32.350734 3880 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:45473
I20260812 16:42:32.355051 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 4299
I20260812 16:42:32.355183 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:32.355408 21961 external_mini_cluster.cc:1428] Setting key bc9b7a454e6919e7555498ff422fad99
I20260812 16:42:32.356276 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.350850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:53191 (local address 127.21.114.126:33445)
0812 16:42:32.350894 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.350896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.351010 (+ 114us) server_negotiation.cc:407] Connection header received
0812 16:42:32.351082 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.351083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.351093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.351142 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.351463 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.351926 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.352661 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.352869 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.352942 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.353847 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.353848 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.353849 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.353855 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.355013 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.355381 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.355382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.355383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.355439 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.355671 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.355672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.355672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.355856 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.355927 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.356120 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.356210 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:42:32.356354 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.350800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.21.114.66:53191)
0812 16:42:32.350935 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.350946 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.351025 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.351145 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.351145 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.351324 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.351379 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.351380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.352023 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.352024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.352583 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.352584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.352954 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.352955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.353026 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.353465 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.353470 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.353738 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.355098 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.355099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.355100 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.355321 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.355536 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.355537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.355537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.355599 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.355928 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.355929 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.355999 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.356075 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.356199 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for oryx/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab.
Entry for principal oryx/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab.
I20260812 16:42:32.382901 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:33445
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:32.465858 4557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:32.466066 4557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:32.466090 4557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:32.467217 4557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:32.467258 4557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:32.467279 4557 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 16:42:32.467324 4557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:32.468865 4557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.114.126:33445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:32.469094 4557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:32.469313 4557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:32.474331 4557 server_base.cc:1034] running on GCE node
W20260812 16:42:32.474388 4564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:32.474314 4568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:32.474305 4571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:32.474749 4557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:32.475052 4557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:32.476217 4557 hybrid_clock.cc:648] HybridClock initialized: now 1786552952476200 us; error 45 us; skew 500 ppm
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:32.478889 4557 init.cc:377] Logged in from keytab as oryx/127.21.114.67@KRBTEST.COM (short username oryx)
I20260812 16:42:32.479310 4557 webserver.cc:460] Webserver started at http://127.21.114.67:43927/ using document root <none> and password file <none>
I20260812 16:42:32.479532 4557 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:32.479599 4557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:32.479745 4557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:32.480844 4557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "3b035c54c1db43e9880c15dd2f822fce"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "417119adc39a736dbda730d079c5e359"
server_key_iv: "932d65599a531cd1b16753a44021152a"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.481215 4557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "3b035c54c1db43e9880c15dd2f822fce"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "417119adc39a736dbda730d079c5e359"
server_key_iv: "932d65599a531cd1b16753a44021152a"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.482707 4557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:32.483460 4588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.483759 4557 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:32.483861 4557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "3b035c54c1db43e9880c15dd2f822fce"
format_stamp: "Formatted at 2026-08-12 16:42:32 on dist-test-slave-45dx"
server_key: "417119adc39a736dbda730d079c5e359"
server_key_iv: "932d65599a531cd1b16753a44021152a"
server_key_version: "encryptionkey@0"
I20260812 16:42:32.483951 4557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:32.492928 4557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:32.494737 4557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:32.494901 4557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:32.495386 4557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:32.495451 4557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.495491 4557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:32.495515 4557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:32.503098 4557 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:46153
I20260812 16:42:32.503311 4795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:46153 every 8 connection(s)
I20260812 16:42:32.503513 4557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:32.506705 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.495888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:55441 (local address 127.21.114.126:33445)
0812 16:42:32.495960 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.495963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.496202 (+ 239us) server_negotiation.cc:407] Connection header received
0812 16:42:32.496952 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.496953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.496965 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.497009 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.497934 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.498807 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.500515 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.500734 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.500811 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.503644 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.503646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.503646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.503655 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.505276 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.505701 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.505702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.505702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.505762 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.506043 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.506044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.506045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.506167 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.506239 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.506534 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.506616 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:32.506886 4604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.495855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.21.114.67:55441)
0812 16:42:32.496052 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.496101 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.496836 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.497090 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.497096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.497527 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.497838 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.497846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.498920 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.498921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.500426 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.500430 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.500857 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.500858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.501007 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.501553 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.501564 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.503546 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.505383 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.505390 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.505392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.505622 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.505854 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.505855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.505856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.505971 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.506242 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.506249 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.506392 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.506493 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.506653 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260812 16:42:32.507400 4796 heartbeater.cc:347] Connected to a master server at 127.21.114.126:33445
I20260812 16:42:32.507476 4796 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:32.507668 4796 heartbeater.cc:511] Master 127.21.114.126:33445 requested a full tablet report, sending...
I20260812 16:42:32.508061 3878 ts_manager.cc:194] Registered new tserver with Master: 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153)
I20260812 16:42:32.508090 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 4557
I20260812 16:42:32.508175 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:32.508419 21961 external_mini_cluster.cc:1428] Setting key 6b5b3387e9b05947978d1afa53efc973
I20260812 16:42:32.508589 3878 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:55441
I20260812 16:42:32.509277 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:42:32.514918 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.508493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:42017 (local address 127.21.114.126:33445)
0812 16:42:32.508531 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.508533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.508756 (+ 223us) server_negotiation.cc:407] Connection header received
0812 16:42:32.508854 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.508855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.508865 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.508909 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.509304 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.509865 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.510922 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.511228 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.511271 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.512266 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.512268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.512268 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.512276 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.513631 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.514073 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.514074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.514075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.514139 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.514394 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.514396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.514396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.514525 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.514588 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.514785 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.514849 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:42:32.515245 4806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.508438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.21.114.67:42017)
0812 16:42:32.508691 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.508703 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.508783 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.508950 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.508951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.509127 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.509223 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.509224 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.509980 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.509982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.510806 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.510808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.511365 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.511366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.511438 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.511902 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.511907 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.512176 (+ 269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.513713 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.513714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.513714 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.513968 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.514221 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.514222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.514222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.514299 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.514600 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.514601 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.514657 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.514738 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.514843 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":73,"threads_started":1}
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 16:42:32.533217 3976 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:32.527692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48248 (local address 127.21.114.126:33445)
0812 16:42:32.527761 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.527763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.527847 (+ 84us) server_negotiation.cc:407] Connection header received
0812 16:42:32.527905 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.527906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.527916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.527967 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.528655 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.529146 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.529908 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.530084 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.530134 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.533136 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48248: BlockingRecv error: recv got EOF from 127.0.0.1:48248 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552952, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:32.540247 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.533988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48258 (local address 127.21.114.126:33445)
0812 16:42:32.534053 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.534055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.534084 (+ 29us) server_negotiation.cc:407] Connection header received
0812 16:42:32.534135 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.534135 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.534143 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.534188 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.534632 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.535067 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.535679 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.535849 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.535896 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.537949 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.537951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.537951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.537957 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.539332 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.539615 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.539616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.539616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.539667 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.539818 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.539818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.539819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.539910 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.539979 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.540134 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.540188 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:42:32.542265 3880 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:32.543812 3880 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:32.550372 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.546123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:46153 (local address 127.0.0.1:43804)
0812 16:42:32.546233 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.546276 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.546345 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.546659 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.546663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.546665 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.546733 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.546735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.548009 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.548010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.549209 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.549211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.550087 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.550088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.550163 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.550177 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.550248 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.550293 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":66,"threads_started":1}
I20260812 16:42:32.550402 4848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.546233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43804 (local address 127.21.114.67:46153)
0812 16:42:32.546412 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.546417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.546430 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:42:32.546472 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.546475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.546494 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.546575 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.546828 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.547928 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.549297 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.550001 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.550075 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.550154 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.550264 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.550302 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":115,"threads_started":1}
I20260812 16:42:32.551092 4851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.546335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.0.0.1:51928)
0812 16:42:32.546464 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.546475 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.546530 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.547184 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.547186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.547188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.547237 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.547238 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.548512 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.548513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.549602 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.549604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.550848 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.550849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.550917 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.550923 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.550985 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.551026 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":97,"threads_started":1}
I20260812 16:42:32.551154 4675 tablet_service.cc:1467] Processing CreateTablet for tablet e991bbd25162490d9ddf25446264ca12 (DEFAULT_TABLE table=test-table [id=9de447fe12c5448ca3e378e335053b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:32.551414 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.546778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51928 (local address 127.21.114.65:43833)
0812 16:42:32.547014 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.547019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.547029 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:32.547066 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.547069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.547084 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.547304 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.547361 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.548420 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.549687 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.550760 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.550848 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.550933 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.551000 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.551036 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":90,"threads_started":1}
I20260812 16:42:32.551587 4675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e991bbd25162490d9ddf25446264ca12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.551644 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.546548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:34941 (local address 127.0.0.1:42600)
0812 16:42:32.546793 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.546804 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.546865 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.548286 (+ 1421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.548287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.548289 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.548349 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.548351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.549418 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.549419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.550383 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.550386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.551413 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.551414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.551473 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.551478 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.551529 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.551566 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":68,"threads_started":1}
I20260812 16:42:32.551954 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.546653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42600 (local address 127.21.114.66:34941)
0812 16:42:32.548081 (+ 1428us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.548085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.548094 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:32.548129 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.548131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.548146 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.548213 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.548425 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.549339 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.550486 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.551229 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.551297 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.551373 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.551798 (+ 425us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.551851 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1395,"thread_start_us":91,"threads_started":1}
I20260812 16:42:32.552205 4154 tablet_service.cc:1467] Processing CreateTablet for tablet e991bbd25162490d9ddf25446264ca12 (DEFAULT_TABLE table=test-table [id=9de447fe12c5448ca3e378e335053b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:32.552587 4154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e991bbd25162490d9ddf25446264ca12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.552562 4427 tablet_service.cc:1467] Processing CreateTablet for tablet e991bbd25162490d9ddf25446264ca12 (DEFAULT_TABLE table=test-table [id=9de447fe12c5448ca3e378e335053b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:32.552899 4427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e991bbd25162490d9ddf25446264ca12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.554751 4863 tablet_bootstrap.cc:492] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Bootstrap starting.
I20260812 16:42:32.555346 4863 tablet_bootstrap.cc:654] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.555567 4863 log.cc:824] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:32.556229 4863 tablet_bootstrap.cc:492] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: No bootstrap required, opened a new log
I20260812 16:42:32.556275 4863 ts_tablet_manager.cc:1397] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:32.556815 4866 tablet_bootstrap.cc:492] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Bootstrap starting.
I20260812 16:42:32.556973 4867 tablet_bootstrap.cc:492] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Bootstrap starting.
I20260812 16:42:32.557351 4866 tablet_bootstrap.cc:654] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.557658 4866 log.cc:824] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:32.557847 4867 tablet_bootstrap.cc:654] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.558215 4867 log.cc:824] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:32.558388 4866 tablet_bootstrap.cc:492] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: No bootstrap required, opened a new log
I20260812 16:42:32.558444 4866 ts_tablet_manager.cc:1397] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:32.558647 4863 raft_consensus.cc:348] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.558831 4863 raft_consensus.cc:374] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.558876 4863 raft_consensus.cc:729] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.558990 4863 consensus_queue.cc:260] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.559165 4867 tablet_bootstrap.cc:492] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: No bootstrap required, opened a new log
I20260812 16:42:32.559235 4867 ts_tablet_manager.cc:1397] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:32.559290 4863 ts_tablet_manager.cc:1428] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:32.559434 4796 heartbeater.cc:503] Master 127.21.114.126:33445 was elected leader, sending a full tablet report...
I20260812 16:42:32.560536 4866 raft_consensus.cc:348] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.560696 4866 raft_consensus.cc:374] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.560734 4866 raft_consensus.cc:729] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.560846 4866 consensus_queue.cc:260] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.561115 4866 ts_tablet_manager.cc:1428] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:32.561153 4281 heartbeater.cc:503] Master 127.21.114.126:33445 was elected leader, sending a full tablet report...
I20260812 16:42:32.561573 4867 raft_consensus.cc:348] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.561682 4867 raft_consensus.cc:374] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.561702 4867 raft_consensus.cc:729] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f88e33b83546da8628ea9b37b0c4f9, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.561833 4867 consensus_queue.cc:260] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.562108 4867 ts_tablet_manager.cc:1428] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:32.562197 4539 heartbeater.cc:503] Master 127.21.114.126:33445 was elected leader, sending a full tablet report...
I20260812 16:42:32.593209 4877 raft_consensus.cc:482] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:32.593384 4877 raft_consensus.cc:504] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.593834 4877 leader_election.cc:288] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153), 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833)
W20260812 16:42:32.596653 4542 tablet.cc:2369] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:32.597689 4848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.594093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:34085 (local address 127.21.114.67:46153)
0812 16:42:32.594141 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.594144 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.594155 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:32.594236 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.594237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.594249 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.594306 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.594504 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.595370 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.596892 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.597305 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.597370 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.597377 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.597572 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.597616 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:42:32.597687 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.594276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:43423 (local address 127.21.114.65:43833)
0812 16:42:32.594323 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.594325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.594439 (+ 114us) server_negotiation.cc:407] Connection header received
0812 16:42:32.594487 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.594488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.594499 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.594555 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.594707 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.595476 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.596887 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.597261 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.597300 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.597308 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.597579 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.597618 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:32.597721 4332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.594021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:46153 (local address 127.21.114.66:34085)
0812 16:42:32.594089 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.594101 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.594150 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.594336 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.594337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.594338 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.594421 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.594423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.595455 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.595456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.596773 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.596777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.597400 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.597401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.597489 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.597491 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.597544 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.597588 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":47}
I20260812 16:42:32.597712 4878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.594139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.21.114.66:43423)
0812 16:42:32.594338 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.594348 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.594407 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.594573 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.594574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.594576 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.594628 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.594629 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.595549 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.595550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.596773 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.596777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.597400 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.597401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.597485 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.597489 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.597544 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.597588 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":10,"thread_start_us":135,"threads_started":1}
I20260812 16:42:32.598098 4712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e991bbd25162490d9ddf25446264ca12" candidate_uuid: "03f88e33b83546da8628ea9b37b0c4f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b035c54c1db43e9880c15dd2f822fce" is_pre_election: true
I20260812 16:42:32.598228 4195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e991bbd25162490d9ddf25446264ca12" candidate_uuid: "03f88e33b83546da8628ea9b37b0c4f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b291bf116604e228f0b3620ac2ddb15" is_pre_election: true
I20260812 16:42:32.598286 4712 raft_consensus.cc:2454] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f88e33b83546da8628ea9b37b0c4f9 in term 0.
I20260812 16:42:32.598407 4195 raft_consensus.cc:2454] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f88e33b83546da8628ea9b37b0c4f9 in term 0.
I20260812 16:42:32.598531 4323 leader_election.cc:302] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f88e33b83546da8628ea9b37b0c4f9, 3b035c54c1db43e9880c15dd2f822fce; no voters:
I20260812 16:42:32.598707 4877 raft_consensus.cc:2781] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:32.598783 4877 raft_consensus.cc:482] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:32.598800 4877 raft_consensus.cc:3037] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.599782 4877 raft_consensus.cc:504] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.599920 4877 leader_election.cc:288] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [CANDIDATE]: Term 1 election: Requested vote from peers 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153), 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833)
I20260812 16:42:32.600126 4195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e991bbd25162490d9ddf25446264ca12" candidate_uuid: "03f88e33b83546da8628ea9b37b0c4f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b291bf116604e228f0b3620ac2ddb15"
I20260812 16:42:32.600149 4712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e991bbd25162490d9ddf25446264ca12" candidate_uuid: "03f88e33b83546da8628ea9b37b0c4f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b035c54c1db43e9880c15dd2f822fce"
I20260812 16:42:32.600224 4712 raft_consensus.cc:3037] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.600229 4195 raft_consensus.cc:3037] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.601004 4712 raft_consensus.cc:2454] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f88e33b83546da8628ea9b37b0c4f9 in term 1.
I20260812 16:42:32.601123 4195 raft_consensus.cc:2454] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f88e33b83546da8628ea9b37b0c4f9 in term 1.
I20260812 16:42:32.601222 4323 leader_election.cc:302] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f88e33b83546da8628ea9b37b0c4f9, 3b035c54c1db43e9880c15dd2f822fce; no voters:
I20260812 16:42:32.601348 4877 raft_consensus.cc:2781] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:32.601563 4877 raft_consensus.cc:686] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 LEADER]: Becoming Leader. State: Replica: 03f88e33b83546da8628ea9b37b0c4f9, State: Running, Role: LEADER
I20260812 16:42:32.601699 4877 consensus_queue.cc:237] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.602566 3880 catalog_manager.cc:5495] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "03f88e33b83546da8628ea9b37b0c4f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:32.610198 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.607830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42614 (local address 127.21.114.66:34941)
0812 16:42:32.607874 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.607876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.607883 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:42:32.607953 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.607954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.607968 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.608024 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:32.608183 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.608675 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.609406 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.609581 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.609632 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.609824 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:32.609914 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:32.609982 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.610104 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.610120 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:42:32.612035 4195 raft_consensus.cc:1261] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Refusing update from remote peer 03f88e33b83546da8628ea9b37b0c4f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:32.612073 4712 raft_consensus.cc:1261] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Refusing update from remote peer 03f88e33b83546da8628ea9b37b0c4f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:32.612504 4877 consensus_queue.cc:1035] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:32.612635 4883 consensus_queue.cc:1035] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:32.615124 4888 mvcc.cc:205] Tried to move back new op lower bound from 7317720893895741440 to 7317720893857292288. Current Snapshot: MvccSnapshot[applied={T|T < 7317720893895741440}]
I20260812 16:42:32.617686 3880 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:32.617776 3880 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:32.618526 3880 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Sending DeleteTablet for 3 replicas of tablet e991bbd25162490d9ddf25446264ca12
I20260812 16:42:32.618857 4675 tablet_service.cc:1514] Processing DeleteTablet for tablet e991bbd25162490d9ddf25446264ca12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:32 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:43804
I20260812 16:42:32.618947 4427 tablet_service.cc:1514] Processing DeleteTablet for tablet e991bbd25162490d9ddf25446264ca12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:32 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:42600
I20260812 16:42:32.619002 3880 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 16:42:32.619095 4901 tablet_replica.cc:330] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: stopping tablet replica
I20260812 16:42:32.619093 4154 tablet_service.cc:1514] Processing DeleteTablet for tablet e991bbd25162490d9ddf25446264ca12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:32 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:51928
W20260812 16:42:32.619145 3880 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:32.619189 4901 raft_consensus.cc:2229] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:32.619297 4901 raft_consensus.cc:2258] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:32.619675 4903 tablet_replica.cc:330] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: stopping tablet replica
I20260812 16:42:32.619753 4901 ts_tablet_manager.cc:1905] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:32.619884 4903 raft_consensus.cc:2229] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:32.620043 4903 raft_consensus.cc:2258] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:32.620564 4903 ts_tablet_manager.cc:1905] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:32.620748 4154 tablet_service.cc:1467] Processing CreateTablet for tablet a295ac3979b9412a8048b2dee0e44dee (DEFAULT_TABLE table=test-table [id=ab8d9d2c3c1f410eb564923ffe3bce5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:32.620795 4427 tablet_service.cc:1467] Processing CreateTablet for tablet a295ac3979b9412a8048b2dee0e44dee (DEFAULT_TABLE table=test-table [id=ab8d9d2c3c1f410eb564923ffe3bce5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:32.620877 4154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a295ac3979b9412a8048b2dee0e44dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.620886 4427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a295ac3979b9412a8048b2dee0e44dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.622095 4901 ts_tablet_manager.cc:1918] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:32.622150 4901 log.cc:1196] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/e991bbd25162490d9ddf25446264ca12
I20260812 16:42:32.622335 4867 tablet_bootstrap.cc:492] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Bootstrap starting.
I20260812 16:42:32.622414 4901 ts_tablet_manager.cc:1939] T e991bbd25162490d9ddf25446264ca12 P 3b035c54c1db43e9880c15dd2f822fce: Deleting consensus metadata
I20260812 16:42:32.622605 4675 tablet_service.cc:1467] Processing CreateTablet for tablet a295ac3979b9412a8048b2dee0e44dee (DEFAULT_TABLE table=test-table [id=ab8d9d2c3c1f410eb564923ffe3bce5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:32.622713 4675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a295ac3979b9412a8048b2dee0e44dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.622815 4867 tablet_bootstrap.cc:654] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.622818 3846 catalog_manager.cc:4841] TS 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153): tablet e991bbd25162490d9ddf25446264ca12 (table test-table [id=9de447fe12c5448ca3e378e335053b0b]) successfully deleted
I20260812 16:42:32.623474 4867 tablet_bootstrap.cc:492] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: No bootstrap required, opened a new log
I20260812 16:42:32.623522 4867 ts_tablet_manager.cc:1397] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:32.623626 4867 raft_consensus.cc:348] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.623667 4867 raft_consensus.cc:374] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.623680 4867 raft_consensus.cc:729] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f88e33b83546da8628ea9b37b0c4f9, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.623740 4867 consensus_queue.cc:260] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.623857 4867 ts_tablet_manager.cc:1428] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.624014 4863 tablet_bootstrap.cc:492] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Bootstrap starting.
I20260812 16:42:32.624028 4866 tablet_bootstrap.cc:492] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Bootstrap starting.
I20260812 16:42:32.624399 4863 tablet_bootstrap.cc:654] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.624482 4866 tablet_bootstrap.cc:654] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.626202 4903 ts_tablet_manager.cc:1918] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:32.626303 4903 log.cc:1196] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/e991bbd25162490d9ddf25446264ca12
I20260812 16:42:32.626618 4866 tablet_bootstrap.cc:492] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: No bootstrap required, opened a new log
I20260812 16:42:32.626677 4866 ts_tablet_manager.cc:1397] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:42:32.626801 4863 tablet_bootstrap.cc:492] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: No bootstrap required, opened a new log
I20260812 16:42:32.626804 4903 ts_tablet_manager.cc:1939] T e991bbd25162490d9ddf25446264ca12 P 8b291bf116604e228f0b3620ac2ddb15: Deleting consensus metadata
I20260812 16:42:32.626860 4863 ts_tablet_manager.cc:1397] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 16:42:32.626854 4866 raft_consensus.cc:348] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.626945 4866 raft_consensus.cc:374] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.626974 4866 raft_consensus.cc:729] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.627017 4866 consensus_queue.cc:260] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.627029 4863 raft_consensus.cc:348] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.627095 4863 raft_consensus.cc:374] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.627125 4866 ts_tablet_manager.cc:1428] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.627125 4863 raft_consensus.cc:729] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.627187 4863 consensus_queue.cc:260] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.627288 4863 ts_tablet_manager.cc:1428] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:32.627748 3846 catalog_manager.cc:4841] TS 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833): tablet e991bbd25162490d9ddf25446264ca12 (table test-table [id=9de447fe12c5448ca3e378e335053b0b]) successfully deleted
I20260812 16:42:32.628441 4902 tablet_replica.cc:330] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: stopping tablet replica
I20260812 16:42:32.628551 4902 raft_consensus.cc:2229] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:32.628647 4902 raft_consensus.cc:2258] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:32.628998 4902 ts_tablet_manager.cc:1905] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:32.630203 4902 ts_tablet_manager.cc:1918] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:32.630297 4902 log.cc:1196] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/e991bbd25162490d9ddf25446264ca12
I20260812 16:42:32.630537 4902 ts_tablet_manager.cc:1939] T e991bbd25162490d9ddf25446264ca12 P 03f88e33b83546da8628ea9b37b0c4f9: Deleting consensus metadata
I20260812 16:42:32.630901 3846 catalog_manager.cc:4841] TS 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941): tablet e991bbd25162490d9ddf25446264ca12 (table test-table [id=9de447fe12c5448ca3e378e335053b0b]) successfully deleted
I20260812 16:42:32.636283 4876 raft_consensus.cc:482] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:32.636380 4876 raft_consensus.cc:504] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.636669 4876 leader_election.cc:288] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941), 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153)
I20260812 16:42:32.640403 4848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.637138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:39685 (local address 127.21.114.67:46153)
0812 16:42:32.637179 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.637181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.637248 (+ 67us) server_negotiation.cc:407] Connection header received
0812 16:42:32.637308 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.637309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.637318 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.637362 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.637529 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.638001 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.639460 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.640024 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.640105 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.640115 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.640262 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.640332 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:32.640434 4915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.636975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:46153 (local address 127.21.114.65:39685)
0812 16:42:32.637195 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.637206 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.637259 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.637373 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.637374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.637375 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.637461 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.637463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.638092 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.638093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.639368 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.639370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.640126 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.640126 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.640176 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.640180 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.640252 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.640297 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":6,"thread_start_us":64,"threads_started":1}
I20260812 16:42:32.640707 4712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a295ac3979b9412a8048b2dee0e44dee" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b035c54c1db43e9880c15dd2f822fce" is_pre_election: true
I20260812 16:42:32.640794 4712 raft_consensus.cc:2454] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 0.
I20260812 16:42:32.640959 4054 leader_election.cc:302] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b035c54c1db43e9880c15dd2f822fce, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:32.641103 4876 raft_consensus.cc:2781] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:32.641147 4876 raft_consensus.cc:482] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:32.641170 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.636916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:41177 (local address 127.21.114.66:34941)
0812 16:42:32.636980 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.636982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.637027 (+ 45us) server_negotiation.cc:407] Connection header received
0812 16:42:32.637101 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.637102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.637113 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.637174 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:32.637355 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.638112 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.640152 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.640750 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.640832 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.640840 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.641048 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.641098 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:42:32.641181 4876 raft_consensus.cc:3037] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.641196 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.636850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:34941 (local address 127.21.114.65:41177)
0812 16:42:32.636973 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.636986 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.637046 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.637209 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.637210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.637212 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:32.637277 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.637278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.638189 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.638190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.639367 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.639370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.640875 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.640876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.640964 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.640967 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.641024 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.641068 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":34}
I20260812 16:42:32.641435 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a295ac3979b9412a8048b2dee0e44dee" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9" is_pre_election: true
I20260812 16:42:32.641541 4462 raft_consensus.cc:2454] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 0.
I20260812 16:42:32.642011 4876 raft_consensus.cc:504] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.642133 4876 leader_election.cc:288] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 election: Requested vote from peers 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941), 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153)
I20260812 16:42:32.642302 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a295ac3979b9412a8048b2dee0e44dee" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9"
I20260812 16:42:32.642314 4712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a295ac3979b9412a8048b2dee0e44dee" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b035c54c1db43e9880c15dd2f822fce"
I20260812 16:42:32.642381 4462 raft_consensus.cc:3037] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.642386 4712 raft_consensus.cc:3037] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.642953 4712 raft_consensus.cc:2454] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 1.
I20260812 16:42:32.643117 4054 leader_election.cc:302] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b035c54c1db43e9880c15dd2f822fce, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:32.643206 4462 raft_consensus.cc:2454] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 1.
I20260812 16:42:32.643221 4876 raft_consensus.cc:2781] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:32.643347 4876 raft_consensus.cc:686] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 1 LEADER]: Becoming Leader. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Running, Role: LEADER
I20260812 16:42:32.643424 4876 consensus_queue.cc:237] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:32.644131 3880 catalog_manager.cc:5495] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } health_report { overall_health: UNKNOWN } } }
Aug 12 16:42:32 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552951, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.126@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:32.681231 4926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.673092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:33445 (local address 127.0.0.1:48274)
0812 16:42:32.673299 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.673312 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.673394 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.673551 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.673552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.673996 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:32.674059 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.674061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.674725 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.674727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.675588 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.675591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.675926 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.675927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.675991 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.676621 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:32.676627 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:32.678298 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:32.680040 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.680048 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.680050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.680249 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.680484 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:32.680484 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:32.680485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:32.680553 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:32.680800 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:32.680809 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:32.680855 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.680946 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.681084 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":2,"thread_start_us":103,"threads_started":1}
I20260812 16:42:32.681231 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.673188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48274 (local address 127.21.114.126:33445)
0812 16:42:32.673245 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.673248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.673389 (+ 141us) server_negotiation.cc:407] Connection header received
0812 16:42:32.673458 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.673458 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.673467 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.673519 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:32.674139 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.674644 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.675674 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.675851 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.675901 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.678399 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:32.678401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:32.678401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:32.678408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:32.679944 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.680352 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.680353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.680354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.680415 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:32.680623 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:32.680624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:32.680624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:32.680734 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:32.680809 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.680970 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.681149 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":31}
I20260812 16:42:32.683722 3880 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:48274:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 16:42:32.683974 3880 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:32.686069 4154 tablet_service.cc:1467] Processing CreateTablet for tablet 816fb45bd687481ab7ffac8caf92ef8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93d5449b1c984fe1a937d55bc758214f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:32.686193 4675 tablet_service.cc:1467] Processing CreateTablet for tablet 816fb45bd687481ab7ffac8caf92ef8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93d5449b1c984fe1a937d55bc758214f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:32.686251 4154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 816fb45bd687481ab7ffac8caf92ef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.686354 4675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 816fb45bd687481ab7ffac8caf92ef8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 16:42:32.687731 4282 tablet.cc:2369] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:32.687963 4866 tablet_bootstrap.cc:492] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: Bootstrap starting.
I20260812 16:42:32.688088 4863 tablet_bootstrap.cc:492] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: Bootstrap starting.
I20260812 16:42:32.688122 4427 tablet_service.cc:1467] Processing CreateTablet for tablet 816fb45bd687481ab7ffac8caf92ef8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93d5449b1c984fe1a937d55bc758214f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 16:42:32.688269 4427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 816fb45bd687481ab7ffac8caf92ef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:32.688423 4866 tablet_bootstrap.cc:654] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.688568 4863 tablet_bootstrap.cc:654] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.689335 4863 tablet_bootstrap.cc:492] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: No bootstrap required, opened a new log
I20260812 16:42:32.689385 4863 ts_tablet_manager.cc:1397] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:32.689430 4866 tablet_bootstrap.cc:492] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: No bootstrap required, opened a new log
I20260812 16:42:32.689479 4866 ts_tablet_manager.cc:1397] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 16:42:32.689534 4863 raft_consensus.cc:348] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.689610 4863 raft_consensus.cc:374] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.689634 4863 raft_consensus.cc:729] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.689628 4866 raft_consensus.cc:348] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.689702 4866 raft_consensus.cc:374] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.689725 4866 raft_consensus.cc:729] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.689682 4863 consensus_queue.cc:260] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.689770 4866 consensus_queue.cc:260] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.689805 4863 ts_tablet_manager.cc:1428] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.689884 4866 ts_tablet_manager.cc:1428] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.690049 4872 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.690099 4916 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.690148 4872 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:32.690179 4916 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:32.690340 4867 tablet_bootstrap.cc:492] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: Bootstrap starting.
I20260812 16:42:32.690654 4867 tablet_bootstrap.cc:654] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:32.691267 4867 tablet_bootstrap.cc:492] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: No bootstrap required, opened a new log
I20260812 16:42:32.691339 4867 ts_tablet_manager.cc:1397] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:32.691457 4867 raft_consensus.cc:348] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.691545 4867 raft_consensus.cc:374] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:32.691572 4867 raft_consensus.cc:729] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f88e33b83546da8628ea9b37b0c4f9, State: Initialized, Role: FOLLOWER
I20260812 16:42:32.691617 4867 consensus_queue.cc:260] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.691709 4867 ts_tablet_manager.cc:1428] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:32.691728 4883 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.691802 4883 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 16:42:32.754117 4797 tablet.cc:2369] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:42:32.947887 4916 raft_consensus.cc:482] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:32.948046 4916 raft_consensus.cc:504] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.948293 4916 leader_election.cc:288] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153), 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:32.948637 4712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816fb45bd687481ab7ffac8caf92ef8f" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b035c54c1db43e9880c15dd2f822fce" is_pre_election: true
I20260812 16:42:32.948637 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816fb45bd687481ab7ffac8caf92ef8f" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9" is_pre_election: true
I20260812 16:42:32.948742 4462 raft_consensus.cc:2454] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 0.
I20260812 16:42:32.948742 4712 raft_consensus.cc:2454] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 0.
I20260812 16:42:32.948949 4054 leader_election.cc:302] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f88e33b83546da8628ea9b37b0c4f9, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:32.949101 4916 raft_consensus.cc:2781] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:32.949189 4916 raft_consensus.cc:482] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:32.949218 4916 raft_consensus.cc:3037] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.949990 4916 raft_consensus.cc:504] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.950170 4916 leader_election.cc:288] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 election: Requested vote from peers 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153), 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:32.950300 4712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816fb45bd687481ab7ffac8caf92ef8f" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b035c54c1db43e9880c15dd2f822fce"
I20260812 16:42:32.950377 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "816fb45bd687481ab7ffac8caf92ef8f" candidate_uuid: "8b291bf116604e228f0b3620ac2ddb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9"
I20260812 16:42:32.950417 4712 raft_consensus.cc:3037] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.950444 4462 raft_consensus.cc:3037] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:32.951217 4712 raft_consensus.cc:2454] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 1.
I20260812 16:42:32.951217 4462 raft_consensus.cc:2454] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b291bf116604e228f0b3620ac2ddb15 in term 1.
I20260812 16:42:32.951426 4054 leader_election.cc:302] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f88e33b83546da8628ea9b37b0c4f9, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:32.951563 4916 raft_consensus.cc:2781] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:32.951638 4916 raft_consensus.cc:686] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [term 1 LEADER]: Becoming Leader. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Running, Role: LEADER
I20260812 16:42:32.951697 4916 consensus_queue.cc:237] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } }
I20260812 16:42:32.952103 4876 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: TxnStatusTablet state changed. Reason: New leader 8b291bf116604e228f0b3620ac2ddb15. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.952196 4876 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:32.952450 4935 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 16:42:32.952477 3880 catalog_manager.cc:5495] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:32.952585 4935 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 16:42:32.977800 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.975115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51938 (local address 127.21.114.65:43833)
0812 16:42:32.975172 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.975174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.975184 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:32.975267 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.975268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.975296 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.975402 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:32.975555 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.976032 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.976906 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.977130 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.977209 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.977418 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:32.977528 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:32.977615 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.977665 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.977685 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 16:42:32.977783 4926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.974983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.0.0.1:51938)
0812 16:42:32.975098 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.975112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.975177 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.975410 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.975411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.975413 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:32.975469 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.975472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.976120 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.976121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.976812 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.976815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.977223 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.977224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.977298 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.977320 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:32.977600 (+ 280us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:32.977610 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.977661 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.977711 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 16:42:32.979081 4462 raft_consensus.cc:1261] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Refusing update from remote peer 8b291bf116604e228f0b3620ac2ddb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:32.979316 4712 raft_consensus.cc:1261] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Refusing update from remote peer 8b291bf116604e228f0b3620ac2ddb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:32.979512 4916 consensus_queue.cc:1035] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:32.979684 4876 consensus_queue.cc:1035] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:32.980381 4883 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: TxnStatusTablet state changed. Reason: New leader 8b291bf116604e228f0b3620ac2ddb15. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.980477 4883 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:32.980615 4872 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: TxnStatusTablet state changed. Reason: New leader 8b291bf116604e228f0b3620ac2ddb15. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.980700 4872 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:32.981172 4916 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.981256 4916 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:32.981594 4892 mvcc.cc:205] Tried to move back new op lower bound from 7317720895399858176 to 7317720895290793984. Current Snapshot: MvccSnapshot[applied={T|T < 7317720895399858176 or (T in {7317720895399858176})}]
I20260812 16:42:32.982112 4876 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.982194 4876 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 8b291bf116604e228f0b3620ac2ddb15: This TxnStatusTablet replica's current role is: LEADER
I20260812 16:42:32.982533 4883 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.982613 4883 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 03f88e33b83546da8628ea9b37b0c4f9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:32.983078 4872 tablet_replica.cc:439] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8b291bf116604e228f0b3620ac2ddb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } }
I20260812 16:42:32.983166 4872 tablet_replica.cc:442] T 816fb45bd687481ab7ffac8caf92ef8f P 3b035c54c1db43e9880c15dd2f822fce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 16:42:32.985566 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.983287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.21.114.65:43833)
0812 16:42:32.983349 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.983351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.983360 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:32.983379 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.983380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.983402 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.983455 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:32.983670 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.984122 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.984869 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.985066 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.985153 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.985308 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:32.985348 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:32.985409 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.985473 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.985491 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:42:32.990613 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.988198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:38895 (local address 127.21.114.65:43833)
0812 16:42:32.988242 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:32.988244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:32.988292 (+ 48us) server_negotiation.cc:407] Connection header received
0812 16:42:32.988379 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:32.988380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:32.988389 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:32.988459 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:32.988579 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.989020 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.989885 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.990059 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.990144 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.990346 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:32.990381 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:32.990442 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:32.990498 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 16:42:32.990514 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 16:42:32.990617 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:32.988050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.21.114.65:38895)
0812 16:42:32.988218 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:32.988230 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:32.988331 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:32.988461 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:32.988462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:32.988463 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:32.988517 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.988518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.989103 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.989104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.989798 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:32.989799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:32.990177 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:32.990178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:32.990261 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:32.990277 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:32.990442 (+ 165us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:32.990444 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:32.990487 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 16:42:32.990525 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260812 16:42:32.994161 4712 raft_consensus.cc:1261] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Refusing update from remote peer 8b291bf116604e228f0b3620ac2ddb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:32.994189 4462 raft_consensus.cc:1261] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Refusing update from remote peer 8b291bf116604e228f0b3620ac2ddb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:32.994411 4946 consensus_queue.cc:1035] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:32.994567 4916 consensus_queue.cc:1035] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:32.995975 4891 mvcc.cc:205] Tried to move back new op lower bound from 7317720895462191104 to 7317720894028062720. Current Snapshot: MvccSnapshot[applied={T|T < 7317720895462191104}]
I20260812 16:42:33.006281 3880 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:33.006376 3880 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:33.007033 3880 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Sending DeleteTablet for 3 replicas of tablet a295ac3979b9412a8048b2dee0e44dee
I20260812 16:42:33.007254 4154 tablet_service.cc:1514] Processing DeleteTablet for tablet a295ac3979b9412a8048b2dee0e44dee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:51928
I20260812 16:42:33.007313 4427 tablet_service.cc:1514] Processing DeleteTablet for tablet a295ac3979b9412a8048b2dee0e44dee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:42600
I20260812 16:42:33.007347 4903 tablet_replica.cc:330] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: stopping tablet replica
I20260812 16:42:33.007359 4675 tablet_service.cc:1514] Processing DeleteTablet for tablet a295ac3979b9412a8048b2dee0e44dee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:43804
I20260812 16:42:33.007400 4903 raft_consensus.cc:2229] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:33.007463 4902 tablet_replica.cc:330] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: stopping tablet replica
I20260812 16:42:33.007479 4903 raft_consensus.cc:2258] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.007519 4902 raft_consensus.cc:2229] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:33.007557 4902 raft_consensus.cc:2258] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.007560 4901 tablet_replica.cc:330] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: stopping tablet replica
I20260812 16:42:33.007608 4901 raft_consensus.cc:2229] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:33.007645 4901 raft_consensus.cc:2258] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.007885 4903 ts_tablet_manager.cc:1905] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.007958 4902 ts_tablet_manager.cc:1905] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.008064 4901 ts_tablet_manager.cc:1905] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.012768 4901 ts_tablet_manager.cc:1918] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:33.012832 4901 log.cc:1196] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/a295ac3979b9412a8048b2dee0e44dee
I20260812 16:42:33.012951 4902 ts_tablet_manager.cc:1918] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:33.013018 4902 log.cc:1196] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/a295ac3979b9412a8048b2dee0e44dee
I20260812 16:42:33.013062 4901 ts_tablet_manager.cc:1939] T a295ac3979b9412a8048b2dee0e44dee P 3b035c54c1db43e9880c15dd2f822fce: Deleting consensus metadata
I20260812 16:42:33.013234 4902 ts_tablet_manager.cc:1939] T a295ac3979b9412a8048b2dee0e44dee P 03f88e33b83546da8628ea9b37b0c4f9: Deleting consensus metadata
I20260812 16:42:33.013401 3846 catalog_manager.cc:4841] TS 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153): tablet a295ac3979b9412a8048b2dee0e44dee (table test-table [id=ab8d9d2c3c1f410eb564923ffe3bce5c]) successfully deleted
I20260812 16:42:33.013545 4903 ts_tablet_manager.cc:1918] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:33.013545 3846 catalog_manager.cc:4841] TS 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941): tablet a295ac3979b9412a8048b2dee0e44dee (table test-table [id=ab8d9d2c3c1f410eb564923ffe3bce5c]) successfully deleted
I20260812 16:42:33.013609 4903 log.cc:1196] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/a295ac3979b9412a8048b2dee0e44dee
I20260812 16:42:33.013835 4903 ts_tablet_manager.cc:1939] T a295ac3979b9412a8048b2dee0e44dee P 8b291bf116604e228f0b3620ac2ddb15: Deleting consensus metadata
I20260812 16:42:33.014156 3846 catalog_manager.cc:4841] TS 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833): tablet a295ac3979b9412a8048b2dee0e44dee (table test-table [id=ab8d9d2c3c1f410eb564923ffe3bce5c]) successfully deleted
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[3787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 16:42:33.035322 3976 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:33.028948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.21.114.126:33445)
0812 16:42:33.029024 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.029027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.029180 (+ 153us) server_negotiation.cc:407] Connection header received
0812 16:42:33.029252 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.029253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.029264 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.029324 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:33.030098 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.030595 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.031661 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.031861 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.031927 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.035240 (+ 3313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48284: BlockingRecv error: recv got EOF from 127.0.0.1:48284 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[3787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM
I20260812 16:42:33.043339 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.036194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48300 (local address 127.21.114.126:33445)
0812 16:42:33.036238 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.036240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.036324 (+ 84us) server_negotiation.cc:407] Connection header received
0812 16:42:33.036518 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.036519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.036529 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.036588 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:33.037047 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.037525 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.038206 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.038407 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.038485 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.040681 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:33.040683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:33.040684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:33.040692 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:33.042171 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:33.042539 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:33.042541 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:33.042541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:33.042605 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:33.042812 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:33.042814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:33.042814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:33.042930 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:33.043041 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:33.043146 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 16:42:33.043224 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:42:33.045037 3880 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:33.045224 3880 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:33.046700 4154 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0a6833216b45108b5eb28f180f411b (DEFAULT_TABLE table=test-table [id=99efa7b312f6441fa9042aff7c248792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:33.046752 4427 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0a6833216b45108b5eb28f180f411b (DEFAULT_TABLE table=test-table [id=99efa7b312f6441fa9042aff7c248792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:33.046846 4154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0a6833216b45108b5eb28f180f411b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:33.046876 4427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0a6833216b45108b5eb28f180f411b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:33.048215 4866 tablet_bootstrap.cc:492] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Bootstrap starting.
I20260812 16:42:33.048265 4675 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0a6833216b45108b5eb28f180f411b (DEFAULT_TABLE table=test-table [id=99efa7b312f6441fa9042aff7c248792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:33.048439 4675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0a6833216b45108b5eb28f180f411b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:33.048710 4866 tablet_bootstrap.cc:654] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:33.049109 4867 tablet_bootstrap.cc:492] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Bootstrap starting.
I20260812 16:42:33.049551 4867 tablet_bootstrap.cc:654] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:33.049849 4863 tablet_bootstrap.cc:492] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Bootstrap starting.
I20260812 16:42:33.050068 4866 tablet_bootstrap.cc:492] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: No bootstrap required, opened a new log
I20260812 16:42:33.050113 4866 ts_tablet_manager.cc:1397] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 16:42:33.050258 4863 tablet_bootstrap.cc:654] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:33.050278 4866 raft_consensus.cc:348] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.050367 4866 raft_consensus.cc:374] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:33.050390 4866 raft_consensus.cc:729] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Initialized, Role: FOLLOWER
I20260812 16:42:33.050442 4866 consensus_queue.cc:260] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.050539 4866 ts_tablet_manager.cc:1428] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:33.050776 4867 tablet_bootstrap.cc:492] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: No bootstrap required, opened a new log
I20260812 16:42:33.050830 4867 ts_tablet_manager.cc:1397] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:42:33.050962 4867 raft_consensus.cc:348] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.051036 4867 raft_consensus.cc:374] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:33.051064 4867 raft_consensus.cc:729] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f88e33b83546da8628ea9b37b0c4f9, State: Initialized, Role: FOLLOWER
I20260812 16:42:33.051107 4867 consensus_queue.cc:260] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.051218 4867 ts_tablet_manager.cc:1428] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:33.051924 4863 tablet_bootstrap.cc:492] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: No bootstrap required, opened a new log
I20260812 16:42:33.051976 4863 ts_tablet_manager.cc:1397] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 16:42:33.052145 4863 raft_consensus.cc:348] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.052244 4863 raft_consensus.cc:374] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:33.052270 4863 raft_consensus.cc:729] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Initialized, Role: FOLLOWER
I20260812 16:42:33.052348 4863 consensus_queue.cc:260] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.052469 4863 ts_tablet_manager.cc:1428] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:33.408655 4872 raft_consensus.cc:482] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:33.408787 4872 raft_consensus.cc:504] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.409198 4872 leader_election.cc:288] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833), 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:33.412644 4981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.409418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.21.114.67:32953)
0812 16:42:33.409626 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:33.409639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:33.409757 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:33.409958 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:33.409959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:33.409962 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:33.410055 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.410058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.410761 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.410762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.411776 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.411779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.412409 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.412410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.412491 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.412495 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:33.412536 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 16:42:33.412567 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":68,"thread_start_us":86,"threads_started":1}
I20260812 16:42:33.412706 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.409512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:32953 (local address 127.21.114.65:43833)
0812 16:42:33.409613 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.409617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.409721 (+ 104us) server_negotiation.cc:407] Connection header received
0812 16:42:33.409852 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.409853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.409864 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.409922 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:33.410138 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.410660 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.411918 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.412281 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.412399 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.412424 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:33.412565 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 16:42:33.412610 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 16:42:33.412947 4195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0a6833216b45108b5eb28f180f411b" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b291bf116604e228f0b3620ac2ddb15" is_pre_election: true
I20260812 16:42:33.413036 4989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.409639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:34941 (local address 127.21.114.67:58261)
0812 16:42:33.409727 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:33.409738 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:33.409845 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:33.410063 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:33.410063 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:33.410066 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:33.410154 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.410156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.410884 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.410885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.411751 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.411754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.412785 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.412787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.412864 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.412869 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:33.412930 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 16:42:33.412968 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":18,"thread_start_us":40,"threads_started":1}
I20260812 16:42:33.413062 4195 raft_consensus.cc:2454] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 0.
I20260812 16:42:33.413283 4991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.409774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:58261 (local address 127.21.114.66:34941)
0812 16:42:33.409930 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.409932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.409942 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:33.409966 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.409967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.409978 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.410051 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:33.410246 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.410770 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.411859 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.412270 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.412366 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.412377 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:33.413146 (+ 769us) server_negotiation.cc:299] Negotiation successful
0812 16:42:33.413209 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260812 16:42:33.413323 4590 leader_election.cc:302] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b035c54c1db43e9880c15dd2f822fce, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:33.413465 4872 raft_consensus.cc:2781] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:33.413515 4872 raft_consensus.cc:482] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:33.413538 4872 raft_consensus.cc:3037] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:33.413504 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0a6833216b45108b5eb28f180f411b" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9" is_pre_election: true
I20260812 16:42:33.413626 4462 raft_consensus.cc:2454] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 0.
I20260812 16:42:33.414291 4872 raft_consensus.cc:504] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.414402 4872 leader_election.cc:288] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 election: Requested vote from peers 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833), 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:33.414597 4195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0a6833216b45108b5eb28f180f411b" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b291bf116604e228f0b3620ac2ddb15"
I20260812 16:42:33.414675 4195 raft_consensus.cc:3037] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:33.414665 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0a6833216b45108b5eb28f180f411b" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9"
I20260812 16:42:33.414763 4462 raft_consensus.cc:3037] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:33.415343 4195 raft_consensus.cc:2454] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 1.
I20260812 16:42:33.415478 4462 raft_consensus.cc:2454] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 1.
I20260812 16:42:33.415508 4590 leader_election.cc:302] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b035c54c1db43e9880c15dd2f822fce, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:33.415603 4872 raft_consensus.cc:2781] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:33.415709 4872 raft_consensus.cc:686] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 1 LEADER]: Becoming Leader. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Running, Role: LEADER
I20260812 16:42:33.415783 4872 consensus_queue.cc:237] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.416513 3880 catalog_manager.cc:5495] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67). New cstate: current_term: 1 leader_uuid: "3b035c54c1db43e9880c15dd2f822fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:33.495554 4998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.493051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43808 (local address 127.21.114.67:46153)
0812 16:42:33.493201 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.493203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.493212 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:33.493255 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.493255 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.493279 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.493356 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:33.493485 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.493993 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.494730 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.494968 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.495028 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.495172 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:33.495290 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:33.495343 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:33.495391 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 16:42:33.495407 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":94,"threads_started":1}
I20260812 16:42:33.496744 4195 raft_consensus.cc:1261] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Refusing update from remote peer 3b035c54c1db43e9880c15dd2f822fce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:33.496743 4462 raft_consensus.cc:1261] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Refusing update from remote peer 3b035c54c1db43e9880c15dd2f822fce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:33.497080 4872 consensus_queue.cc:1035] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:33.497254 4994 consensus_queue.cc:1035] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:33.500617 3878 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:33.500701 3878 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:33.501410 3878 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Sending DeleteTablet for 3 replicas of tablet 8c0a6833216b45108b5eb28f180f411b
I20260812 16:42:33.501657 4154 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c0a6833216b45108b5eb28f180f411b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:51928
I20260812 16:42:33.501677 4427 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c0a6833216b45108b5eb28f180f411b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:42600
I20260812 16:42:33.501788 4902 tablet_replica.cc:330] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: stopping tablet replica
I20260812 16:42:33.501780 4903 tablet_replica.cc:330] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: stopping tablet replica
I20260812 16:42:33.501840 4903 raft_consensus.cc:2229] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:33.501866 4902 raft_consensus.cc:2229] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:33.501891 4903 raft_consensus.cc:2258] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.501910 4902 raft_consensus.cc:2258] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.502081 4675 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c0a6833216b45108b5eb28f180f411b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:43804
I20260812 16:42:33.502168 4901 tablet_replica.cc:330] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: stopping tablet replica
I20260812 16:42:33.502218 4901 raft_consensus.cc:2229] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:33.502239 4902 ts_tablet_manager.cc:1905] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.502291 4903 ts_tablet_manager.cc:1905] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.502314 4901 raft_consensus.cc:2258] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.502269 3878 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:33.502424 3878 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:33.503909 4901 ts_tablet_manager.cc:1905] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.504144 4903 ts_tablet_manager.cc:1918] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:33.504201 4903 log.cc:1196] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/8c0a6833216b45108b5eb28f180f411b
I20260812 16:42:33.504192 4902 ts_tablet_manager.cc:1918] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:33.504242 4902 log.cc:1196] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/8c0a6833216b45108b5eb28f180f411b
I20260812 16:42:33.504488 4902 ts_tablet_manager.cc:1939] T 8c0a6833216b45108b5eb28f180f411b P 03f88e33b83546da8628ea9b37b0c4f9: Deleting consensus metadata
I20260812 16:42:33.504498 4903 ts_tablet_manager.cc:1939] T 8c0a6833216b45108b5eb28f180f411b P 8b291bf116604e228f0b3620ac2ddb15: Deleting consensus metadata
I20260812 16:42:33.504803 3846 catalog_manager.cc:4841] TS 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941): tablet 8c0a6833216b45108b5eb28f180f411b (table test-table [id=99efa7b312f6441fa9042aff7c248792]) successfully deleted
I20260812 16:42:33.504890 3846 catalog_manager.cc:4841] TS 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833): tablet 8c0a6833216b45108b5eb28f180f411b (table test-table [id=99efa7b312f6441fa9042aff7c248792]) successfully deleted
I20260812 16:42:33.505434 4901 ts_tablet_manager.cc:1918] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:33.505475 4901 log.cc:1196] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/8c0a6833216b45108b5eb28f180f411b
I20260812 16:42:33.505623 4901 ts_tablet_manager.cc:1939] T 8c0a6833216b45108b5eb28f180f411b P 3b035c54c1db43e9880c15dd2f822fce: Deleting consensus metadata
I20260812 16:42:33.506584 3846 catalog_manager.cc:4841] TS 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153): tablet 8c0a6833216b45108b5eb28f180f411b (table test-table [id=99efa7b312f6441fa9042aff7c248792]) successfully deleted
I20260812 16:42:33.507119 4427 tablet_service.cc:1467] Processing CreateTablet for tablet 73c5bab04773464abc52c54cfffe1ac6 (DEFAULT_TABLE table=test-table [id=3baec0abdbf34d4f8bb8f8490dc219b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:33.507156 4154 tablet_service.cc:1467] Processing CreateTablet for tablet 73c5bab04773464abc52c54cfffe1ac6 (DEFAULT_TABLE table=test-table [id=3baec0abdbf34d4f8bb8f8490dc219b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:33.507233 4427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c5bab04773464abc52c54cfffe1ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:33.507244 4154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c5bab04773464abc52c54cfffe1ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:33.508404 4867 tablet_bootstrap.cc:492] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Bootstrap starting.
I20260812 16:42:33.508549 4675 tablet_service.cc:1467] Processing CreateTablet for tablet 73c5bab04773464abc52c54cfffe1ac6 (DEFAULT_TABLE table=test-table [id=3baec0abdbf34d4f8bb8f8490dc219b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:33.508665 4675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c5bab04773464abc52c54cfffe1ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:33.508733 4867 tablet_bootstrap.cc:654] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:33.509032 4866 tablet_bootstrap.cc:492] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: Bootstrap starting.
I20260812 16:42:33.509379 4866 tablet_bootstrap.cc:654] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:33.509405 4867 tablet_bootstrap.cc:492] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: No bootstrap required, opened a new log
I20260812 16:42:33.509449 4867 ts_tablet_manager.cc:1397] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:33.509558 4867 raft_consensus.cc:348] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.509649 4867 raft_consensus.cc:374] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:33.509681 4867 raft_consensus.cc:729] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f88e33b83546da8628ea9b37b0c4f9, State: Initialized, Role: FOLLOWER
I20260812 16:42:33.509737 4867 consensus_queue.cc:260] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.509797 4863 tablet_bootstrap.cc:492] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Bootstrap starting.
I20260812 16:42:33.509864 4867 ts_tablet_manager.cc:1428] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:33.510186 4866 tablet_bootstrap.cc:492] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: No bootstrap required, opened a new log
I20260812 16:42:33.510205 4863 tablet_bootstrap.cc:654] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:33.510236 4866 ts_tablet_manager.cc:1397] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:33.510352 4866 raft_consensus.cc:348] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.510428 4866 raft_consensus.cc:374] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:33.510454 4866 raft_consensus.cc:729] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b291bf116604e228f0b3620ac2ddb15, State: Initialized, Role: FOLLOWER
I20260812 16:42:33.510504 4866 consensus_queue.cc:260] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.510591 4866 ts_tablet_manager.cc:1428] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:33.516772 4863 tablet_bootstrap.cc:492] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: No bootstrap required, opened a new log
I20260812 16:42:33.516850 4863 ts_tablet_manager.cc:1397] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260812 16:42:33.517014 4863 raft_consensus.cc:348] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.517092 4863 raft_consensus.cc:374] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:33.517117 4863 raft_consensus.cc:729] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Initialized, Role: FOLLOWER
I20260812 16:42:33.517171 4863 consensus_queue.cc:260] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.517270 4863 ts_tablet_manager.cc:1428] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:33.776000 4994 raft_consensus.cc:482] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:33.776152 4994 raft_consensus.cc:504] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.776469 4994 leader_election.cc:288] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833), 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:33.776710 4195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c5bab04773464abc52c54cfffe1ac6" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b291bf116604e228f0b3620ac2ddb15" is_pre_election: true
I20260812 16:42:33.776839 4195 raft_consensus.cc:2454] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 0.
I20260812 16:42:33.776769 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c5bab04773464abc52c54cfffe1ac6" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9" is_pre_election: true
I20260812 16:42:33.776883 4462 raft_consensus.cc:2454] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 0.
I20260812 16:42:33.777026 4590 leader_election.cc:302] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b035c54c1db43e9880c15dd2f822fce, 8b291bf116604e228f0b3620ac2ddb15; no voters:
I20260812 16:42:33.777204 4994 raft_consensus.cc:2781] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:33.777256 4994 raft_consensus.cc:482] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:33.777282 4994 raft_consensus.cc:3037] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:33.778086 4994 raft_consensus.cc:504] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.778242 4994 leader_election.cc:288] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 election: Requested vote from peers 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833), 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941)
I20260812 16:42:33.778517 4195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c5bab04773464abc52c54cfffe1ac6" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b291bf116604e228f0b3620ac2ddb15"
I20260812 16:42:33.778517 4462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c5bab04773464abc52c54cfffe1ac6" candidate_uuid: "3b035c54c1db43e9880c15dd2f822fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f88e33b83546da8628ea9b37b0c4f9"
I20260812 16:42:33.778611 4462 raft_consensus.cc:3037] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:33.778612 4195 raft_consensus.cc:3037] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:33.779443 4462 raft_consensus.cc:2454] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 1.
I20260812 16:42:33.779443 4195 raft_consensus.cc:2454] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b035c54c1db43e9880c15dd2f822fce in term 1.
I20260812 16:42:33.779627 4590 leader_election.cc:302] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f88e33b83546da8628ea9b37b0c4f9, 3b035c54c1db43e9880c15dd2f822fce; no voters:
I20260812 16:42:33.779788 4994 raft_consensus.cc:2781] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:33.779867 4994 raft_consensus.cc:686] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 1 LEADER]: Becoming Leader. State: Replica: 3b035c54c1db43e9880c15dd2f822fce, State: Running, Role: LEADER
I20260812 16:42:33.779924 4994 consensus_queue.cc:237] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } }
I20260812 16:42:33.780629 3880 catalog_manager.cc:5495] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67). New cstate: current_term: 1 leader_uuid: "3b035c54c1db43e9880c15dd2f822fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b035c54c1db43e9880c15dd2f822fce" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260812 16:42:33.799975 4860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.797571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:33733 (local address 127.21.114.65:43833)
0812 16:42:33.797639 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.797641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.797813 (+ 172us) server_negotiation.cc:407] Connection header received
0812 16:42:33.797840 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.797841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.797850 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.797903 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:33.798013 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.798498 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.799300 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.799497 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.799556 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.799744 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:33.799770 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:33.799810 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:33.799902 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 16:42:33.799921 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:33.799996 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.797490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.21.114.67:33733)
0812 16:42:33.797714 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:33.797730 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:33.797788 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:33.797917 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:33.797918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:33.797920 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:33.797965 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.797967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.798581 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.798582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.799202 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.799204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.799585 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.799586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.799647 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.799662 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:33.799845 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:33.799847 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:33.799891 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 16:42:33.799936 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":102,"threads_started":1}
I20260812 16:42:33.801819 4462 raft_consensus.cc:1261] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Refusing update from remote peer 3b035c54c1db43e9880c15dd2f822fce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:33.801991 4195 raft_consensus.cc:1261] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Refusing update from remote peer 3b035c54c1db43e9880c15dd2f822fce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:33.802125 4872 consensus_queue.cc:1035] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f88e33b83546da8628ea9b37b0c4f9" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:33.802225 4994 consensus_queue.cc:1035] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b291bf116604e228f0b3620ac2ddb15" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:33.809638 4998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.807085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:46259 (local address 127.21.114.67:46153)
0812 16:42:33.807122 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:33.807125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:33.807196 (+ 71us) server_negotiation.cc:407] Connection header received
0812 16:42:33.807272 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:33.807273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:33.807288 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:33.807358 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:33.807488 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.807991 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.808857 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.809154 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.809240 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.809400 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:33.809439 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:33.809491 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:33.809561 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 16:42:33.809587 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 16:42:33.809669 5026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.807011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:46153 (local address 127.21.114.65:46259)
0812 16:42:33.807140 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:33.807153 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:33.807211 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:33.807363 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:33.807364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:33.807366 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 16:42:33.807410 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.807411 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.808056 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.808057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.808725 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:33.808727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:33.809241 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:33.809242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:33.809317 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:33.809323 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 16:42:33.809511 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 16:42:33.809513 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:33.809559 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 16:42:33.809610 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":80,"threads_started":1}
I20260812 16:42:33.818883 3878 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:33.818993 3878 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:33.819686 3878 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a16650a6422048288c8c1987c025529b: Sending DeleteTablet for 3 replicas of tablet 73c5bab04773464abc52c54cfffe1ac6
I20260812 16:42:33.819931 4154 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c5bab04773464abc52c54cfffe1ac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:51928
I20260812 16:42:33.819972 4427 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c5bab04773464abc52c54cfffe1ac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:42600
I20260812 16:42:33.820044 4903 tablet_replica.cc:330] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: stopping tablet replica
I20260812 16:42:33.820071 4902 tablet_replica.cc:330] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: stopping tablet replica
I20260812 16:42:33.820102 4903 raft_consensus.cc:2229] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:33.820118 4902 raft_consensus.cc:2229] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:33.820135 4903 raft_consensus.cc:2258] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.820150 4902 raft_consensus.cc:2258] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.820273 4675 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c5bab04773464abc52c54cfffe1ac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:33 UTC) from {username='oryx', principal='oryx/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:43804
I20260812 16:42:33.820390 4901 tablet_replica.cc:330] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: stopping tablet replica
I20260812 16:42:33.820449 4901 raft_consensus.cc:2229] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:33.820433 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 4024
I20260812 16:42:33.820518 4901 raft_consensus.cc:2258] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:33.820648 4903 ts_tablet_manager.cc:1905] T 73c5bab04773464abc52c54cfffe1ac6 P 8b291bf116604e228f0b3620ac2ddb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.821333 4902 ts_tablet_manager.cc:1905] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.823530 4902 ts_tablet_manager.cc:1918] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:33.823603 4902 log.cc:1196] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/73c5bab04773464abc52c54cfffe1ac6
I20260812 16:42:33.823854 4902 ts_tablet_manager.cc:1939] T 73c5bab04773464abc52c54cfffe1ac6 P 03f88e33b83546da8628ea9b37b0c4f9: Deleting consensus metadata
I20260812 16:42:33.824278 3846 catalog_manager.cc:4841] TS 03f88e33b83546da8628ea9b37b0c4f9 (127.21.114.66:34941): tablet 73c5bab04773464abc52c54cfffe1ac6 (table test-table [id=3baec0abdbf34d4f8bb8f8490dc219b5]) successfully deleted
I20260812 16:42:33.824667 4901 ts_tablet_manager.cc:1905] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:33.825894 4901 ts_tablet_manager.cc:1918] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 16:42:33.825953 4901 log.cc:1196] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/73c5bab04773464abc52c54cfffe1ac6
I20260812 16:42:33.826134 4901 ts_tablet_manager.cc:1939] T 73c5bab04773464abc52c54cfffe1ac6 P 3b035c54c1db43e9880c15dd2f822fce: Deleting consensus metadata
I20260812 16:42:33.826582 3846 catalog_manager.cc:4841] TS 3b035c54c1db43e9880c15dd2f822fce (127.21.114.67:46153): tablet 73c5bab04773464abc52c54cfffe1ac6 (table test-table [id=3baec0abdbf34d4f8bb8f8490dc219b5]) successfully deleted
W20260812 16:42:33.837330 3846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:43833 (error 108)
I20260812 16:42:33.837968 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 4299
I20260812 16:42:33.837996 5031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:33.837783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43833 (local address 127.0.0.1:51952)
0812 16:42:33.837903 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:33.837960 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
W20260812 16:42:33.840530 3846 catalog_manager.cc:4584] TS 8b291bf116604e228f0b3620ac2ddb15 (127.21.114.65:43833): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 73c5bab04773464abc52c54cfffe1ac6: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43833: connect: Connection refused (error 111)
I20260812 16:42:33.848170 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 4557
I20260812 16:42:33.859138 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 3815
2026-08-12T16:42:33Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3540 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[5039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[5039](info): set up 2 sockets
Aug 12 16:42:33 dist-test-slave-45dx krb5kdc[5039](info): commencing operation
krb5kdc: starting...
W20260812 16:42:35.194183 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:35 dist-test-slave-45dx krb5kdc[5039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:35.322656 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:44787
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:33483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:44787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:35.404265 5068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:35.404495 5068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:35.404516 5068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:35.405668 5068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:35.405710 5068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:35.405725 5068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:35.405738 5068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:35.405756 5068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:35.407259 5068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:33483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:44787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:44787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:35.407527 5068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:35.407774 5068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:35.412885 5081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:35.412900 5076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:35.412905 5077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:35.412974 5068 server_base.cc:1034] running on GCE node
I20260812 16:42:35.413367 5068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:35.413654 5068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:35.414824 5068 hybrid_clock.cc:648] HybridClock initialized: now 1786552955414826 us; error 59 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T16:42:35Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1554 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:35 dist-test-slave-45dx krb5kdc[5087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:35 dist-test-slave-45dx krb5kdc[5087](info): set up 2 sockets
Aug 12 16:42:35 dist-test-slave-45dx krb5kdc[5087](info): commencing operation
krb5kdc: starting...
W20260812 16:42:36.727471 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:36 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:36.863168 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:46863
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:46863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:36.946483 5116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:36.946728 5116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:36.946765 5116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:36.947903 5116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:36.947975 5116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:36.948000 5116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:36.948020 5116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:36.948047 5116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:36.949559 5116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:46863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:46863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:36.949838 5116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:36.950079 5116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:36.955194 5116 server_base.cc:1034] running on GCE node
W20260812 16:42:36.955124 5131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:36.955154 5130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:36.955165 5134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:36.955651 5116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:36.955963 5116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:36.957135 5116 hybrid_clock.cc:648] HybridClock initialized: now 1786552956957126 us; error 35 us; skew 500 ppm
Aug 12 16:42:36 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552956, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:36.965210 5116 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:36.965651 5116 webserver.cc:460] Webserver started at http://127.21.114.126:34347/ using document root <none> and password file <none>
I20260812 16:42:36.965938 5116 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:36.966022 5116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:36.966193 5116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:36.967243 5116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "cd0f13d7e7534949928569fecf18c3ea"
format_stamp: "Formatted at 2026-08-12 16:42:36 on dist-test-slave-45dx"
server_key: "007d784f82365e35418757b56c0190f4"
server_key_iv: "96172fccd0af8b5b508d55078e028bb7"
server_key_version: "encryptionkey@0"
I20260812 16:42:36.967613 5116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "cd0f13d7e7534949928569fecf18c3ea"
format_stamp: "Formatted at 2026-08-12 16:42:36 on dist-test-slave-45dx"
server_key: "007d784f82365e35418757b56c0190f4"
server_key_iv: "96172fccd0af8b5b508d55078e028bb7"
server_key_version: "encryptionkey@0"
I20260812 16:42:36.969075 5116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:36.969883 5150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:36.970072 5116 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:36.970183 5116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "cd0f13d7e7534949928569fecf18c3ea"
format_stamp: "Formatted at 2026-08-12 16:42:36 on dist-test-slave-45dx"
server_key: "007d784f82365e35418757b56c0190f4"
server_key_iv: "96172fccd0af8b5b508d55078e028bb7"
server_key_version: "encryptionkey@0"
I20260812 16:42:36.970258 5116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:36.996042 5116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:36.998627 5116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:36.998809 5116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:37.002856 5116 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:46863
I20260812 16:42:37.002908 5243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:46863 every 8 connection(s)
I20260812 16:42:37.003310 5116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:37.004276 5245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:37.006712 5245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Bootstrap starting.
I20260812 16:42:37.007335 5245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:37.007655 5245 log.cc:824] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:37.008419 5245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: No bootstrap required, opened a new log
I20260812 16:42:37.009075 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 5116
I20260812 16:42:37.009208 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:37.009408 21961 external_mini_cluster.cc:1428] Setting key 2a575265a81c741f6bad7d9f462bbade
I20260812 16:42:37.010689 5245 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.010906 5245 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:37.010951 5245 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0f13d7e7534949928569fecf18c3ea, State: Initialized, Role: FOLLOWER
I20260812 16:42:37.011089 5245 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.011178 5245 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:37.011207 5245 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:37.011264 5245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:37.012410 5245 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.012522 5245 leader_election.cc:302] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd0f13d7e7534949928569fecf18c3ea; no voters:
I20260812 16:42:37.012705 5245 leader_election.cc:288] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:37.012776 5255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:37.012943 5255 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 LEADER]: Becoming Leader. State: Replica: cd0f13d7e7534949928569fecf18c3ea, State: Running, Role: LEADER
I20260812 16:42:37.012953 5245 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:37.013067 5255 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.013638 5259 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd0f13d7e7534949928569fecf18c3ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } } }
I20260812 16:42:37.013723 5259 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:37.013906 5260 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd0f13d7e7534949928569fecf18c3ea. Latest consensus state: current_term: 1 leader_uuid: "cd0f13d7e7534949928569fecf18c3ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } } }
I20260812 16:42:37.013976 5260 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:37.013945 5277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:37.014855 5277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:37.016460 5277 catalog_manager.cc:1347] Generated new cluster ID: 4ff076f57cba4174b3c99bef06801ff2
I20260812 16:42:37.016516 5277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:37.022591 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.009953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37664 (local address 127.21.114.126:46863)
0812 16:42:37.010145 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.010156 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.010194 (+ 38us) server_negotiation.cc:407] Connection header received
0812 16:42:37.010645 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.010654 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.010722 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.010878 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.011671 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.014154 (+ 2483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.015263 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.015785 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.015930 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.018740 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:37.018744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:37.018745 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:37.018758 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:37.020870 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.021271 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.021273 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.021274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.021417 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.021639 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.021640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.021640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.021989 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:37.022159 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:37.022242 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 16:42:37.022383 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260812 16:42:37.024544 5277 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:37.025055 5277 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:37.027562 5277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Generated new TSK 0
I20260812 16:42:37.027741 5277 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:37.059072 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46863
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:37.147871 5302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:37.148106 5302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:37.148145 5302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:37.149338 5302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:37.149407 5302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:37.149451 5302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:37.150907 5302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:37.151186 5302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:37.151425 5302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:37.156620 5310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.156643 5314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.156694 5302 server_base.cc:1034] running on GCE node
W20260812 16:42:37.156646 5311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.157083 5302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:37.157372 5302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:37.158516 5302 hybrid_clock.cc:648] HybridClock initialized: now 1786552957158499 us; error 34 us; skew 500 ppm
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:37.161167 5302 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:37.161634 5302 webserver.cc:460] Webserver started at http://127.21.114.65:35695/ using document root <none> and password file <none>
I20260812 16:42:37.161897 5302 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:37.161948 5302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:37.162084 5302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:37.163130 5302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "da28bcb3b3df46159178d6c92d03edc7"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "b9427615ffce20091f72875c0f43a127"
server_key_iv: "80fdb444a8a147aa7f4914a722d55023"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.163494 5302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "da28bcb3b3df46159178d6c92d03edc7"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "b9427615ffce20091f72875c0f43a127"
server_key_iv: "80fdb444a8a147aa7f4914a722d55023"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.164935 5302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 16:42:37.165709 5324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.165931 5302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:37.166034 5302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "da28bcb3b3df46159178d6c92d03edc7"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "b9427615ffce20091f72875c0f43a127"
server_key_iv: "80fdb444a8a147aa7f4914a722d55023"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.166109 5302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:37.196215 5302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:37.198814 5302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:37.198936 5302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:37.199137 5302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:37.199478 5302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:37.199517 5302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.199540 5302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:37.199590 5302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.205664 5302 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:36909
I20260812 16:42:37.205718 5548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:36909 every 8 connection(s)
I20260812 16:42:37.206041 5302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:37.215164 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.206753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:35015 (local address 127.21.114.126:46863)
0812 16:42:37.206831 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.206833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.207089 (+ 256us) server_negotiation.cc:407] Connection header received
0812 16:42:37.207573 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.207574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.207584 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.207644 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.208633 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.209142 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.210119 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.210320 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.210372 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.212466 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:37.212467 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:37.212468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:37.212474 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:37.213866 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.214352 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.214354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.214354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.214415 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.214669 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.214669 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.214670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.214775 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:37.214838 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:37.215030 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 16:42:37.215099 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 16:42:37.215430 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 5302
I20260812 16:42:37.215557 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:37.215757 21961 external_mini_cluster.cc:1428] Setting key 93685c3fd5e40a233558ad7625698b0d
I20260812 16:42:37.216135 5553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.206736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:35015)
0812 16:42:37.206950 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:37.206993 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:37.207486 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:37.207698 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:37.207702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:37.208311 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:37.208536 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.208542 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.209232 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.209233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.210039 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.210042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.210394 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.210395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.210493 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.210973 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:37.210982 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:37.212377 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:37.213936 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:37.213942 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:37.213944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:37.214236 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:37.214493 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:37.214493 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:37.214494 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:37.214611 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:37.214829 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:37.214832 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:37.214942 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 16:42:37.215017 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 16:42:37.215132 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":123,"threads_started":1}
I20260812 16:42:37.216718 5550 heartbeater.cc:347] Connected to a master server at 127.21.114.126:46863
I20260812 16:42:37.216827 5550 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:37.217024 5550 heartbeater.cc:511] Master 127.21.114.126:46863 requested a full tablet report, sending...
I20260812 16:42:37.217528 5183 ts_manager.cc:194] Registered new tserver with Master: da28bcb3b3df46159178d6c92d03edc7 (127.21.114.65:36909)
I20260812 16:42:37.218250 5183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:35015
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:37.242775 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46863
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:37.327778 5562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:37.327988 5562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:37.328011 5562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:37.329232 5562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:37.329276 5562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:37.329303 5562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:37.330752 5562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:37.331000 5562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:37.331243 5562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:37.336294 5576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.336347 5573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.336347 5569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.336576 5562 server_base.cc:1034] running on GCE node
I20260812 16:42:37.336817 5562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:37.337054 5562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:37.338244 5562 hybrid_clock.cc:648] HybridClock initialized: now 1786552957338232 us; error 33 us; skew 500 ppm
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:37.340942 5562 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:37.341377 5562 webserver.cc:460] Webserver started at http://127.21.114.66:45179/ using document root <none> and password file <none>
I20260812 16:42:37.341610 5562 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:37.341658 5562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:37.341804 5562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:37.342868 5562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "7e22e65e267e40ad9a7d0ba8f1bc4e26"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "6e81aa488f12735ecf554370d55677c0"
server_key_iv: "88fe5303baacd2aa6bf2e074371317f8"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.343233 5562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "7e22e65e267e40ad9a7d0ba8f1bc4e26"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "6e81aa488f12735ecf554370d55677c0"
server_key_iv: "88fe5303baacd2aa6bf2e074371317f8"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.344631 5562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:42:37.345363 5589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.345537 5562 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:37.345644 5562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "7e22e65e267e40ad9a7d0ba8f1bc4e26"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "6e81aa488f12735ecf554370d55677c0"
server_key_iv: "88fe5303baacd2aa6bf2e074371317f8"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.345719 5562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:37.355901 5562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:37.357791 5562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:37.357951 5562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:37.358160 5562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:37.358470 5562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:37.358533 5562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.358575 5562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:37.358603 5562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.364524 5562 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:41613
I20260812 16:42:37.364586 5781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:41613 every 8 connection(s)
I20260812 16:42:37.364904 5562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:37.368096 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 5562
I20260812 16:42:37.368187 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:37.368423 21961 external_mini_cluster.cc:1428] Setting key 44ab8062a5385974e57f695aff7c5dea
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:37.375291 5784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.365587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:54413)
0812 16:42:37.365759 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:37.365793 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:37.366240 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:37.366438 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:37.366441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:37.366993 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:37.367175 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.367180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.367871 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.367872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.369085 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.369088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.369496 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.369497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.369642 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.370187 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:37.370198 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:37.371851 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:37.373886 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:37.373892 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:37.373894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:37.374199 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:37.374427 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:37.374428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:37.374428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:37.374527 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:37.374821 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:37.374830 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:37.374940 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 16:42:37.375020 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 16:42:37.375137 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":107,"threads_started":1}
I20260812 16:42:37.375325 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.365636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:54413 (local address 127.21.114.126:46863)
0812 16:42:37.365717 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.365719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.365882 (+ 163us) server_negotiation.cc:407] Connection header received
0812 16:42:37.366321 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.366322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.366332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.366385 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.367267 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.367780 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.369165 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.369402 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.369461 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.371943 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:37.371945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:37.371945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:37.371954 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:37.373793 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.374279 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.374281 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.374282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.374352 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.374595 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.374596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.374596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.374751 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:37.374829 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:37.375075 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 16:42:37.375178 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 16:42:37.375830 5782 heartbeater.cc:347] Connected to a master server at 127.21.114.126:46863
I20260812 16:42:37.375916 5782 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:37.376103 5782 heartbeater.cc:511] Master 127.21.114.126:46863 requested a full tablet report, sending...
I20260812 16:42:37.376525 5183 ts_manager.cc:194] Registered new tserver with Master: 7e22e65e267e40ad9a7d0ba8f1bc4e26 (127.21.114.66:41613)
I20260812 16:42:37.377034 5183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:54413
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:37.395591 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46863
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:37.478740 5788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:37.478940 5788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:37.478962 5788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:37.480053 5788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:37.480087 5788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:37.480113 5788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:37.481562 5788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:37.481768 5788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:37.481942 5788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:37.487630 5803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.487641 5797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.487715 5788 server_base.cc:1034] running on GCE node
W20260812 16:42:37.487641 5799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.488041 5788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:37.488339 5788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:37.489506 5788 hybrid_clock.cc:648] HybridClock initialized: now 1786552957489491 us; error 29 us; skew 500 ppm
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:37.492206 5788 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:37.492662 5788 webserver.cc:460] Webserver started at http://127.21.114.67:44471/ using document root <none> and password file <none>
I20260812 16:42:37.492924 5788 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:37.492995 5788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:37.493146 5788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:37.494203 5788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "cfe7b0c505a0448fb41387e32c891d1f"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "066b491b078b60fcc437cb0c36995800"
server_key_iv: "2681784c90b4e69d2856cf321e77a349"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.494587 5788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "cfe7b0c505a0448fb41387e32c891d1f"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "066b491b078b60fcc437cb0c36995800"
server_key_iv: "2681784c90b4e69d2856cf321e77a349"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.495949 5788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:37.496822 5811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.497044 5788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:42:37.497138 5788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "cfe7b0c505a0448fb41387e32c891d1f"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "066b491b078b60fcc437cb0c36995800"
server_key_iv: "2681784c90b4e69d2856cf321e77a349"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.497210 5788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:37.506737 5788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:37.509200 5788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:37.509366 5788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:37.509600 5788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:37.509912 5788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:37.509966 5788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.510010 5788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:37.510039 5788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.516731 5788 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:36263
I20260812 16:42:37.516785 6008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:36263 every 8 connection(s)
I20260812 16:42:37.517107 5788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:37.520504 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 5788
I20260812 16:42:37.520622 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:37.520821 21961 external_mini_cluster.cc:1428] Setting key 2c4163312da14ad6ee1de1261cb3722a
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:37.526964 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.517914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:52537 (local address 127.21.114.126:46863)
0812 16:42:37.517959 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.517961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.518189 (+ 228us) server_negotiation.cc:407] Connection header received
0812 16:42:37.518662 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.518663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.518674 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.518726 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.519661 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.520195 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.521857 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.522080 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.522138 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.524383 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:37.524384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:37.524384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:37.524391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:37.525662 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.526053 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.526054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.526054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.526113 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:37.526368 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:37.526368 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:37.526369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:37.526475 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:37.526538 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:37.526823 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 16:42:37.526891 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:42:37.527184 6012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.517904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:52537)
0812 16:42:37.518060 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:37.518098 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:37.518573 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:37.518791 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:37.518794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:37.519377 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:37.519573 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.519577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.520359 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.520361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.521705 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.521708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.522160 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.522161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.522264 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.522819 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:37.522828 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:37.524247 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:37.525739 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:37.525745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:37.525746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:37.525967 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:37.526183 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:37.526184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:37.526184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:37.526302 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:37.526573 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:37.526578 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:37.526697 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 16:42:37.526796 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 16:42:37.526923 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260812 16:42:37.527766 6010 heartbeater.cc:347] Connected to a master server at 127.21.114.126:46863
I20260812 16:42:37.527881 6010 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:37.528096 6010 heartbeater.cc:511] Master 127.21.114.126:46863 requested a full tablet report, sending...
I20260812 16:42:37.528501 5183 ts_manager.cc:194] Registered new tserver with Master: cfe7b0c505a0448fb41387e32c891d1f (127.21.114.67:36263)
I20260812 16:42:37.528862 5183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:52537
I20260812 16:42:37.532768 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab.
Entry for principal oryx/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab.
WARNING: no policy specified for oryx/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab.
Entry for principal oryx/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab.
WARNING: no policy specified for oryx/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab.
Entry for principal oryx/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab.
I20260812 16:42:37.606716 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 5302
I20260812 16:42:37.629446 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 5562
I20260812 16:42:37.642513 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 5788
I20260812 16:42:37.650574 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 5116
I20260812 16:42:37.665171 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:46863
--webserver_interface=127.21.114.126
--webserver_port=34347
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:46863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:37.751515 6026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:37.751735 6026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:37.751760 6026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:37.753015 6026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:37.753062 6026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:37.753077 6026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:37.753088 6026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:37.753140 6026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:37.754664 6026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:46863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:46863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=34347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:37.754933 6026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:37.755189 6026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:37.760205 6037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.760197 6034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.760216 6039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.760456 6026 server_base.cc:1034] running on GCE node
I20260812 16:42:37.760720 6026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:37.761001 6026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:37.762179 6026 hybrid_clock.cc:648] HybridClock initialized: now 1786552957762163 us; error 34 us; skew 500 ppm
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:37.764860 6026 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:37.765316 6026 webserver.cc:460] Webserver started at http://127.21.114.126:34347/ using document root <none> and password file <none>
I20260812 16:42:37.765573 6026 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:37.765630 6026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:37.767017 6026 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:37.767740 6051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.767951 6026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:37.768064 6026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "cd0f13d7e7534949928569fecf18c3ea"
format_stamp: "Formatted at 2026-08-12 16:42:36 on dist-test-slave-45dx"
server_key: "007d784f82365e35418757b56c0190f4"
server_key_iv: "96172fccd0af8b5b508d55078e028bb7"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.768471 6026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:37.791265 6026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:37.793503 6026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:37.793694 6026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:37.799247 6026 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:46863
I20260812 16:42:37.799325 6141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:46863 every 8 connection(s)
I20260812 16:42:37.799834 6026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:37.800580 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 6026
I20260812 16:42:37.800917 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:36909
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:46863
--webserver_port=35695
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:42:37.802126 6142 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:42:37.803194 6142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Bootstrap starting.
I20260812 16:42:37.812712 6142 log.cc:824] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:37.814700 6142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:42:37.815042 6142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Bootstrap complete.
I20260812 16:42:37.817551 6142 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.817783 6142 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0f13d7e7534949928569fecf18c3ea, State: Initialized, Role: FOLLOWER
I20260812 16:42:37.817962 6142 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.818023 6142 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:37.818073 6142 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:37.818123 6142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:42:37.819131 6142 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.819222 6142 leader_election.cc:302] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd0f13d7e7534949928569fecf18c3ea; no voters:
I20260812 16:42:37.819463 6142 leader_election.cc:288] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 16:42:37.819504 6149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 2 FOLLOWER]: Leader election won for term 2
I20260812 16:42:37.819690 6149 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [term 2 LEADER]: Becoming Leader. State: Replica: cd0f13d7e7534949928569fecf18c3ea, State: Running, Role: LEADER
I20260812 16:42:37.819747 6142 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:37.819890 6149 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } }
I20260812 16:42:37.820219 6149 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd0f13d7e7534949928569fecf18c3ea. Latest consensus state: current_term: 2 leader_uuid: "cd0f13d7e7534949928569fecf18c3ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } } }
I20260812 16:42:37.820353 6152 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cd0f13d7e7534949928569fecf18c3ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd0f13d7e7534949928569fecf18c3ea" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 46863 } } }
I20260812 16:42:37.820415 6149 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:37.820526 6152 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:37.820945 6165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:37.821491 6165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:37.821807 6165 catalog_manager.cc:1259] Loaded cluster ID: 4ff076f57cba4174b3c99bef06801ff2
I20260812 16:42:37.821955 6165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:37.823097 6165 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:37.823268 6165 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cd0f13d7e7534949928569fecf18c3ea: Loaded TSK: 0
I20260812 16:42:37.823474 6165 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 16:42:37.889607 6146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:37.889816 6146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:37.889849 6146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:37.891161 6146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:37.891208 6146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:37.891235 6146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:37.892764 6146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.65.keytab
--principal=oryx/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:36909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=35695
--tserver_master_addrs=127.21.114.126:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:37.893010 6146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:37.893263 6146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:37.899390 6193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.899397 6188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:37.899514 6187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:37.899681 6146 server_base.cc:1034] running on GCE node
I20260812 16:42:37.899907 6146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:37.900194 6146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:37.901389 6146 hybrid_clock.cc:648] HybridClock initialized: now 1786552957901376 us; error 47 us; skew 500 ppm
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552957, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:37.904606 6146 init.cc:377] Logged in from keytab as oryx/127.21.114.65@KRBTEST.COM (short username oryx)
I20260812 16:42:37.905167 6146 webserver.cc:460] Webserver started at http://127.21.114.65:35695/ using document root <none> and password file <none>
I20260812 16:42:37.905421 6146 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:37.905506 6146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:37.906915 6146 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:42:37.907559 6203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.907724 6146 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:42:37.907845 6146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "da28bcb3b3df46159178d6c92d03edc7"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "b9427615ffce20091f72875c0f43a127"
server_key_iv: "80fdb444a8a147aa7f4914a722d55023"
server_key_version: "encryptionkey@0"
I20260812 16:42:37.908197 6146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:37.932173 6146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:37.934725 6146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:37.934900 6146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:37.935211 6146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:37.935622 6146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:37.935662 6146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.935685 6146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:37.935698 6146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:37.943470 6146 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:36909
I20260812 16:42:37.943552 6430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:36909 every 8 connection(s)
I20260812 16:42:37.943924 6146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:37.949339 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 6146
I20260812 16:42:37.949693 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:41613
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:46863
--webserver_port=45179
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:37.953167 6433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.944743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:53045)
0812 16:42:37.944966 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:37.945014 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:37.945627 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:37.946082 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:37.946086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:37.946742 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:37.946950 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.946955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.947991 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.947991 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.948897 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.948900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.949523 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.949525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.949680 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.950204 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:37.950216 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:37.952934 (+ 2718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":97,"threads_started":1}
W20260812 16:42:37.953186 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:37.944876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53045 (local address 127.21.114.126:46863)
0812 16:42:37.945061 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.945070 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.945111 (+ 41us) server_negotiation.cc:407] Connection header received
0812 16:42:37.945813 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.945818 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.945880 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.945989 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.947054 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.947901 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.948975 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.949374 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.949523 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.953058 (+ 3535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:53045: BlockingRecv error: recv got EOF from 127.21.114.65:53045 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
W20260812 16:42:37.953475 6431 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:46863 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.114.126:46863: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:37.958662 6433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.953733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:34965)
0812 16:42:37.953777 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:37.953791 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:37.953837 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:37.953959 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:37.953960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:37.954120 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:37.954175 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.954177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.954845 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.954846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.955760 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.955763 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.956111 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.956112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.956193 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.956692 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:37.956696 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:37.958579 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 16:42:37.958715 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:37.953779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:34965 (local address 127.21.114.126:46863)
0812 16:42:37.953815 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.953819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.953835 (+ 16us) server_negotiation.cc:407] Connection header received
0812 16:42:37.953896 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.953897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.953906 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.953947 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.954244 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.954760 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.955858 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.956037 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.956085 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.958653 (+ 2568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:34965: BlockingRecv error: recv got EOF from 127.21.114.65:34965 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:37 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:37.963537 6433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:37.958968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:47775)
0812 16:42:37.959009 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:37.959018 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:37.959053 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:37.959217 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:37.959217 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:37.959332 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:37.959366 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.959367 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.960367 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.960367 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.960841 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:37.960843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.961342 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.961343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:37.961381 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.961844 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:37.961848 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:37.963495 (+ 1647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 16:42:37.963654 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:37.959011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:47775 (local address 127.21.114.126:46863)
0812 16:42:37.959083 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:37.959085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:37.959096 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:37.959120 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:37.959121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:37.959134 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:37.959197 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:37.959459 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.960218 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.960927 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:37.961250 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:37.961322 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:37.963598 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:47775: BlockingRecv error: recv got EOF from 127.21.114.65:47775 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 16:42:37.963725 6431 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 16:42:38.036927 6435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:38.037118 6435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:38.037142 6435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:38.038247 6435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:38.038282 6435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:38.038307 6435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:38.039664 6435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.66.keytab
--principal=oryx/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:41613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=45179
--tserver_master_addrs=127.21.114.126:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:38.039914 6435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:38.040153 6435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:38.045322 6435 server_base.cc:1034] running on GCE node
W20260812 16:42:38.045291 6444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:38.045328 6443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:38.045296 6451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:38.045750 6435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:38.046023 6435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:38.047181 6435 hybrid_clock.cc:648] HybridClock initialized: now 1786552958047164 us; error 45 us; skew 500 ppm
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552958, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:38.049769 6435 init.cc:377] Logged in from keytab as oryx/127.21.114.66@KRBTEST.COM (short username oryx)
I20260812 16:42:38.050225 6435 webserver.cc:460] Webserver started at http://127.21.114.66:45179/ using document root <none> and password file <none>
I20260812 16:42:38.050479 6435 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:38.050590 6435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:38.051913 6435 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:38.052533 6472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:38.052706 6435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:38.052812 6435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "7e22e65e267e40ad9a7d0ba8f1bc4e26"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "6e81aa488f12735ecf554370d55677c0"
server_key_iv: "88fe5303baacd2aa6bf2e074371317f8"
server_key_version: "encryptionkey@0"
I20260812 16:42:38.053141 6435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:38.067060 6435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:38.068910 6435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:38.069075 6435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:38.069303 6435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:38.069617 6435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:38.069672 6435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:38.069712 6435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:38.069741 6435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:38.075908 6435 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:41613
I20260812 16:42:38.075964 6689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:41613 every 8 connection(s)
I20260812 16:42:38.076325 6435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 16:42:38.083472 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.077048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:33489 (local address 127.21.114.126:46863)
0812 16:42:38.077132 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.077134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.077344 (+ 210us) server_negotiation.cc:407] Connection header received
0812 16:42:38.077790 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.077792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.077807 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.077859 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.078739 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.079239 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.080202 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.080462 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.080517 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.083423 (+ 2906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:33489: BlockingRecv error: recv got EOF from 127.21.114.66:33489 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 16:42:38.083478 6694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.077028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:33489)
0812 16:42:38.077219 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.077253 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.077706 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.077921 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.077924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.078479 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.078664 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.078668 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.079317 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.079318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.080127 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.080129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.080533 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.080535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.080636 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.081177 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.081185 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.083336 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":109,"threads_started":1}
W20260812 16:42:38.083786 6691 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:46863 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.114.126:46863: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
I20260812 16:42:38.086350 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 6435
I20260812 16:42:38.086663 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:36263
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:46863
--webserver_port=44471
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:38.088398 6694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.084068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:51823)
0812 16:42:38.084122 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.084135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.084183 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.084345 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.084346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.084475 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.084518 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.084519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.085097 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.085098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.085590 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.085591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.085916 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.085917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.085976 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.086431 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.086436 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.088280 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 16:42:38.088486 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.084138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51823 (local address 127.21.114.126:46863)
0812 16:42:38.084175 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.084176 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.084183 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:42:38.084249 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.084250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.084258 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.084339 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.084579 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.085029 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.085657 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.085835 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.085885 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.088407 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:51823: BlockingRecv error: recv got EOF from 127.21.114.66:51823 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:38.093281 6694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.088765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:47217)
0812 16:42:38.088804 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.088814 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.088879 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.089035 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.089036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.089174 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.089200 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.089202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.090032 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.090033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.090528 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.090530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.090876 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.090877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.090929 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.091416 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.091423 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.093189 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 16:42:38.093314 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.088843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:47217 (local address 127.21.114.126:46863)
0812 16:42:38.088885 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.088887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.088898 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:38.088946 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.088947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.088957 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.089020 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.089272 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.089946 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.090624 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.090804 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.090879 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.093256 (+ 2377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:47217: BlockingRecv error: recv got EOF from 127.21.114.66:47217 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 16:42:38.093432 6691 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 16:42:38.172408 6696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:38.172598 6696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:38.172621 6696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:38.173767 6696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:38.173815 6696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:38.173866 6696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:38.175295 6696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/krb5kdc/oryx_127.21.114.67.keytab
--principal=oryx/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:36263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=44471
--tserver_master_addrs=127.21.114.126:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:38.175532 6696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:38.175786 6696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:38.180652 6702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:38.180650 6701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:38.180676 6704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:38.181092 6696 server_base.cc:1034] running on GCE node
I20260812 16:42:38.181353 6696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:38.181589 6696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:38.182757 6696 hybrid_clock.cc:648] HybridClock initialized: now 1786552958182738 us; error 52 us; skew 500 ppm
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552958, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:38.185441 6696 init.cc:377] Logged in from keytab as oryx/127.21.114.67@KRBTEST.COM (short username oryx)
I20260812 16:42:38.185881 6696 webserver.cc:460] Webserver started at http://127.21.114.67:44471/ using document root <none> and password file <none>
I20260812 16:42:38.186139 6696 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:38.186241 6696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:38.187659 6696 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:38.188454 6716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:38.188642 6696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:38.188750 6696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "cfe7b0c505a0448fb41387e32c891d1f"
format_stamp: "Formatted at 2026-08-12 16:42:37 on dist-test-slave-45dx"
server_key: "066b491b078b60fcc437cb0c36995800"
server_key_iv: "2681784c90b4e69d2856cf321e77a349"
server_key_version: "encryptionkey@0"
I20260812 16:42:38.189123 6696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:38.212007 6696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:38.214504 6696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:38.214682 6696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:38.214946 6696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:38.215276 6696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:38.215332 6696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:38.215368 6696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:38.215412 6696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:38.221828 6696 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:36263
I20260812 16:42:38.221884 6919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:36263 every 8 connection(s)
I20260812 16:42:38.222311 6696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:38.223237 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 6696
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 16:42:38.231056 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.223144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:53471 (local address 127.21.114.126:46863)
0812 16:42:38.223204 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.223206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.223489 (+ 283us) server_negotiation.cc:407] Connection header received
0812 16:42:38.224135 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.224136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.224151 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.224185 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.225363 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.225885 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.227211 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.227413 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.227497 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.230977 (+ 3480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:53471: BlockingRecv error: recv got EOF from 127.21.114.67:53471 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 16:42:38.231137 6922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.223109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:53471)
0812 16:42:38.223324 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.223381 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.224040 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.224265 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.224277 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.225067 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.225260 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.225265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.225975 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.225976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.227122 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.227124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.227510 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.227511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.227653 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.228182 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.228189 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.230910 (+ 2721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":93,"threads_started":1}
W20260812 16:42:38.231372 6920 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:46863 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.114.126:46863: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
I20260812 16:42:38.231838 6926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.223800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37672 (local address 127.21.114.126:46863)
0812 16:42:38.223932 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.223934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.223950 (+ 16us) server_negotiation.cc:407] Connection header received
0812 16:42:38.223981 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.223982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.223992 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.224049 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.224921 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.225507 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.226479 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.226684 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.226735 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.228158 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:38.228162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:38.228162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:38.228177 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:38.229934 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:38.230313 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:38.230317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:38.230317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:38.230449 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:38.230656 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:38.230658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:38.230658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:38.230972 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:38.231108 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:38.231551 (+ 443us) server_negotiation.cc:299] Negotiation successful
0812 16:42:38.231708 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:38.235961 6927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.231592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:58639)
0812 16:42:38.231747 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.231757 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.231820 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.231974 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.231975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.232095 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.232164 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.232166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.232978 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.232978 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.233513 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.233515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.233831 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.233832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.233879 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.234315 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.234334 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.235906 (+ 1572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
W20260812 16:42:38.236061 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.231673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:58639 (local address 127.21.114.126:46863)
0812 16:42:38.231727 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.231729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.231817 (+ 88us) server_negotiation.cc:407] Connection header received
0812 16:42:38.231860 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.231861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.231871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.231934 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.232237 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.232929 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.233581 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.233750 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.233801 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.235991 (+ 2190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:58639: BlockingRecv error: recv got EOF from 127.21.114.67:58639 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:38.240370 6927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.236277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:35569)
0812 16:42:38.236389 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.236402 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.236457 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.236572 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.236572 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.236700 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.236727 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.236728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.237347 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.237347 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.237840 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.237841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.238214 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.238215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.238292 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.238699 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.238704 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.240267 (+ 1563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260812 16:42:38.240414 6434 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.236357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:35569 (local address 127.21.114.126:46863)
0812 16:42:38.236415 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.236417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.236442 (+ 25us) server_negotiation.cc:407] Connection header received
0812 16:42:38.236512 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.236513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.236523 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.236571 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.236808 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.237261 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.237923 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.238119 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.238213 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.240357 (+ 2144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:35569: BlockingRecv error: recv got EOF from 127.21.114.67:35569 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 16:42:38.240527 6920 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:38 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:38.968930 6928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:38.964130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:38741)
0812 16:42:38.964286 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:38.964320 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:38.964385 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:38.964557 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:38.964558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:38.964735 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:38.964785 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.964786 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.965453 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.965454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.966004 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:38.966006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.966372 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.966373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:38.966415 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.966915 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:38.966920 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:38.968861 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
W20260812 16:42:38.969054 6933 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:38.964229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:38741 (local address 127.21.114.126:46863)
0812 16:42:38.964378 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:38.964380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:38.964388 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:38.964446 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:38.964447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:38.964458 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:38.964512 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:38.964864 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.965375 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.966091 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:38.966301 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:38.966359 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:38.968966 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:38741: BlockingRecv error: recv got EOF from 127.21.114.65:38741 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":107,"threads_started":1}
Aug 12 16:42:39 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:39 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:39.098954 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:39.093878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:34907)
0812 16:42:39.094043 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:39.094059 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:39.094133 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:39.094291 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:39.094292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:39.094480 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:39.094528 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:39.094529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.095209 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.095210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:39.095875 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:39.095878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.096247 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.096249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:39.096326 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:39.097023 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:39.097028 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:39.098886 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":87,"threads_started":1}
W20260812 16:42:39.099078 6933 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:39.093934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:34907 (local address 127.21.114.126:46863)
0812 16:42:39.094006 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:39.094008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:39.094115 (+ 107us) server_negotiation.cc:407] Connection header received
0812 16:42:39.094195 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:39.094196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:39.094209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:39.094283 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:39.094612 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.095123 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.095963 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.096170 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.096262 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:39.098994 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:34907: BlockingRecv error: recv got EOF from 127.21.114.66:34907 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 16:42:39 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:39 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:39.246007 6937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:39.240979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:40067)
0812 16:42:39.241136 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:39.241150 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:39.241225 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:39.241430 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:39.241431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:39.241631 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:39.241718 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:39.241720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.242419 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.242421 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:39.242978 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:39.242980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.243354 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.243355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:39.243452 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:39.243906 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:39.243912 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:39.245947 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":107,"threads_started":1}
W20260812 16:42:39.246172 6933 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:39.241113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:40067 (local address 127.21.114.126:46863)
0812 16:42:39.241165 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:39.241167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:39.241231 (+ 64us) server_negotiation.cc:407] Connection header received
0812 16:42:39.241324 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:39.241325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:39.241339 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:39.241419 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:39.241820 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.242328 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.243067 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.243277 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.243355 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:39.246087 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:40067: BlockingRecv error: recv got EOF from 127.21.114.67:40067 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 16:42:39 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:39 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:39.975167 6938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:39.969489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:52145)
0812 16:42:39.969674 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:39.969688 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:39.969791 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:39.969981 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:39.969982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:39.970157 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:39.970210 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:39.970212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.970948 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.970949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:39.971566 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:39.971569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.971996 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.971997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:39.972049 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:39.972770 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:39.972776 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:39.975107 (+ 2331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":80,"threads_started":1}
W20260812 16:42:39.975353 6942 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:39.969608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:52145 (local address 127.21.114.126:46863)
0812 16:42:39.969757 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:39.969759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:39.969770 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:39.969878 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:39.969879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:39.969891 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:39.969958 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:39.970278 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.970872 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.971660 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:39.971886 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:39.971948 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:39.975194 (+ 3246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:52145: BlockingRecv error: recv got EOF from 127.21.114.65:52145 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
Aug 12 16:42:40 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:40 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:40.104130 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:40.099464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:48413)
0812 16:42:40.099615 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:40.099627 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:40.099691 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:40.099836 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:40.099837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:40.100020 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:40.100071 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:40.100072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.100774 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.100775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:40.101291 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:40.101293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.101666 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.101667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:40.101709 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:40.102252 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:40.102258 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:40.104070 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":105,"threads_started":1}
W20260812 16:42:40.104252 6942 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:40.099532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:48413 (local address 127.21.114.126:46863)
0812 16:42:40.099607 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:40.099609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:40.099691 (+ 82us) server_negotiation.cc:407] Connection header received
0812 16:42:40.099737 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:40.099739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:40.099750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:40.099818 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:40.100136 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.100705 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.101390 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.101591 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.101659 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:40.104201 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:48413: BlockingRecv error: recv got EOF from 127.21.114.66:48413 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 16:42:40 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:40 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:40.251714 6946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:40.246488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:40825)
0812 16:42:40.246651 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:40.246667 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:40.246717 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:40.246918 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:40.246919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:40.247083 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:40.247135 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:40.247137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.248129 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.248130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:40.248799 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:40.248801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.249122 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.249123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:40.249168 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:40.249646 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:40.249651 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:40.251648 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
W20260812 16:42:40.251789 6942 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:40.246634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:40825 (local address 127.21.114.126:46863)
0812 16:42:40.246707 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:40.246709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:40.246718 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:40.246809 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:40.246810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:40.246845 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:40.246899 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:40.247236 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.248025 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.248877 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.249055 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.249105 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:40.251737 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:40825: BlockingRecv error: recv got EOF from 127.21.114.67:40825 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 16:42:40 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:40 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:40.980262 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:40.975632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:36661)
0812 16:42:40.975813 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:40.975825 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:40.975895 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:40.976032 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:40.976033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:40.976210 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:40.976268 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:40.976269 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.976982 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.976983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:40.977518 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:40.977519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.977834 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.977835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:40.977875 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:40.978323 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:40.978327 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:40.980147 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":96,"threads_started":1}
W20260812 16:42:40.980334 6954 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:40.975716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:36661 (local address 127.21.114.126:46863)
0812 16:42:40.975881 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:40.975889 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:40.975897 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:40.975943 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:40.975943 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:40.975954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:40.976011 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:40.976410 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.976916 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.977586 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:40.977773 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:40.977821 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:40.980228 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:36661: BlockingRecv error: recv got EOF from 127.21.114.65:36661 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
Aug 12 16:42:41 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:41 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:41.109547 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:41.104752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:36151)
0812 16:42:41.104904 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:41.104917 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:41.104979 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:41.105106 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:41.105107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:41.105273 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:41.105328 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:41.105330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.106037 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.106038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:41.106573 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:41.106574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.106922 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.106923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:41.106967 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:41.107498 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:41.107503 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:41.109475 (+ 1972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":103,"threads_started":1}
W20260812 16:42:41.109678 6954 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:41.104855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:36151 (local address 127.21.114.126:46863)
0812 16:42:41.104923 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:41.104925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:41.104964 (+ 39us) server_negotiation.cc:407] Connection header received
0812 16:42:41.105025 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:41.105026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:41.105037 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:41.105093 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:41.105419 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.105933 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.106655 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.106851 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.106908 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:41.109577 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:36151: BlockingRecv error: recv got EOF from 127.21.114.66:36151 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 16:42:41 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:41 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:41.257542 6956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:41.252224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:35847)
0812 16:42:41.252472 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:41.252484 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:41.252591 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:41.252773 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:41.252774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:41.252962 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:41.253011 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:41.253013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.253980 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.253981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:41.254522 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:41.254524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.254920 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.254921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:41.254981 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:41.255490 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:41.255495 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:41.257444 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":177,"threads_started":1}
W20260812 16:42:41.257581 6954 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:41.252368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:35847 (local address 127.21.114.126:46863)
0812 16:42:41.252444 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:41.252447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:41.252570 (+ 123us) server_negotiation.cc:407] Connection header received
0812 16:42:41.252674 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:41.252675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:41.252698 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:41.252765 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:41.253096 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.253888 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.254611 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.254828 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.254917 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:41.257520 (+ 2603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:35847: BlockingRecv error: recv got EOF from 127.21.114.67:35847 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 12 16:42:41 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:41 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:41.989207 6961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:41.980757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:57179)
0812 16:42:41.980992 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:41.981007 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:41.981097 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:41.981266 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:41.981266 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:41.981455 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:41.981511 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:41.981512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.982204 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.982205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:41.982784 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:41.982786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.983117 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.983118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:41.983161 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:41.987201 (+ 4040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:41.987206 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:41.989143 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
W20260812 16:42:41.989380 6962 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:41.980843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:57179 (local address 127.21.114.126:46863)
0812 16:42:41.980960 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:41.980962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:41.981088 (+ 126us) server_negotiation.cc:407] Connection header received
0812 16:42:41.981165 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:41.981165 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:41.981176 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:41.981232 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:41.981578 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.982108 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.982861 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:41.983051 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:41.983100 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:41.989273 (+ 6173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:57179: BlockingRecv error: recv got EOF from 127.21.114.65:57179 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
Aug 12 16:42:42 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:42 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:42.114940 6963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:42.109995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:51601)
0812 16:42:42.110159 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:42.110171 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:42.110262 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:42.110466 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:42.110468 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:42.110681 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:42.110742 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:42.110744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.111430 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.111432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:42.112050 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:42.112053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.112489 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.112490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:42.112553 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:42.113080 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:42.113086 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:42.114878 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
W20260812 16:42:42.115064 6962 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:42.110079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51601 (local address 127.21.114.126:46863)
0812 16:42:42.110149 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:42.110151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:42.110241 (+ 90us) server_negotiation.cc:407] Connection header received
0812 16:42:42.110358 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:42.110359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:42.110370 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:42.110430 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:42.110824 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.111341 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.112136 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.112412 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.112489 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:42.114991 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:51601: BlockingRecv error: recv got EOF from 127.21.114.66:51601 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 16:42:42 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:42 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:42.263566 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:42.258041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:57659)
0812 16:42:42.258181 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:42.258192 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:42.258273 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:42.258399 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:42.258400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:42.258569 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:42.258620 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:42.258622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.259295 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.259296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:42.259849 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:42.259850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.260362 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.260364 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:42.260425 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:42.260936 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:42.260942 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:42.263457 (+ 2515us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
W20260812 16:42:42.263666 6962 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:42.258135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:57659 (local address 127.21.114.126:46863)
0812 16:42:42.258205 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:42.258207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:42.258258 (+ 51us) server_negotiation.cc:407] Connection header received
0812 16:42:42.258316 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:42.258317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:42.258329 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:42.258383 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:42.258682 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.259227 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.259926 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.260243 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.260355 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:42.263580 (+ 3225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:57659: BlockingRecv error: recv got EOF from 127.21.114.67:57659 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 16:42:42 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:42 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:42.994729 6965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:42.989708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:54185)
0812 16:42:42.989861 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:42.989874 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:42.989935 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:42.990091 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:42.990091 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:42.990271 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:42.990324 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:42.990326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.991049 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.991049 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:42.991658 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:42.991661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.992151 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.992152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:42.992192 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:42.992802 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:42.992807 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:42.994667 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
W20260812 16:42:42.994892 6967 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:42.989823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:54185 (local address 127.21.114.126:46863)
0812 16:42:42.989962 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:42.989964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:42.989973 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:42.989998 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:42.989998 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:42.990009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:42.990076 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:42.990441 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.990974 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.991732 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:42.992081 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:42.992139 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:42.994802 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:54185: BlockingRecv error: recv got EOF from 127.21.114.65:54185 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
Aug 12 16:42:43 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:43 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:43.120333 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:43.115530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:43679)
0812 16:42:43.115656 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:43.115667 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:43.115775 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:43.115946 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:43.115946 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:43.116112 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:43.116163 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:43.116165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.116908 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.116909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:43.117466 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:43.117468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.117790 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.117791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:43.117834 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:43.118293 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:43.118298 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:43.120200 (+ 1902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
W20260812 16:42:43.120532 6967 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:43.115627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:43679 (local address 127.21.114.126:46863)
0812 16:42:43.115667 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:43.115669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:43.115817 (+ 148us) server_negotiation.cc:407] Connection header received
0812 16:42:43.115846 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:43.115847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:43.115859 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:43.115917 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:43.116228 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.116825 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.117540 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.117722 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.117792 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:43.120412 (+ 2620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:43679: BlockingRecv error: recv got EOF from 127.21.114.66:43679 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 12 16:42:43 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:43 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:43.269421 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:43.264223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:38057)
0812 16:42:43.264436 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:43.264448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:43.264519 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:43.264676 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:43.264677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:43.264854 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:43.264904 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:43.264905 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.265598 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.265598 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:43.266453 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:43.266457 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.266840 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.266841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:43.266883 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:43.267334 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:43.267339 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:43.269355 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":130,"threads_started":1}
W20260812 16:42:43.269590 6967 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:43.264350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:38057 (local address 127.21.114.126:46863)
0812 16:42:43.264447 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:43.264449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:43.264529 (+ 80us) server_negotiation.cc:407] Connection header received
0812 16:42:43.264560 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:43.264561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:43.264574 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:43.264638 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:43.264980 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.265529 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.266557 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.266765 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.266829 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:43.269501 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:38057: BlockingRecv error: recv got EOF from 127.21.114.67:38057 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 16:42:43 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:43 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:43.999817 6973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:43.995270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:33809)
0812 16:42:43.995391 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:43.995406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:43.995477 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:43.995610 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:43.995611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:43.995779 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:43.995846 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:43.995848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.996565 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.996566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:43.997098 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:43.997100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.997442 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.997443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:43.997493 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:43.997960 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:43.997964 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:43.999756 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":64,"threads_started":1}
W20260812 16:42:43.999946 6978 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:43.995346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:33809 (local address 127.21.114.126:46863)
0812 16:42:43.995503 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:43.995505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:43.995513 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:43.995536 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:43.995537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:43.995547 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:43.995600 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:43.995917 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.996495 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.997177 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:43.997376 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:43.997430 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:43.999861 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:33809: BlockingRecv error: recv got EOF from 127.21.114.65:33809 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
Aug 12 16:42:44 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:44 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:44.125793 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:44.120995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:44691)
0812 16:42:44.121176 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:44.121192 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:44.121260 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:44.121400 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:44.121401 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:44.121588 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:44.121656 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:44.121658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.122442 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.122443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:44.123110 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:44.123113 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.123444 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.123444 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:44.123502 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:44.123973 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:44.123977 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:44.125727 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":73,"threads_started":1}
W20260812 16:42:44.125916 6978 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:44.121056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:44691 (local address 127.21.114.126:46863)
0812 16:42:44.121117 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:44.121120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:44.121258 (+ 138us) server_negotiation.cc:407] Connection header received
0812 16:42:44.121318 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:44.121319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:44.121331 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:44.121385 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:44.121716 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.122339 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.123182 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.123374 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.123430 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:44.125818 (+ 2388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:44691: BlockingRecv error: recv got EOF from 127.21.114.66:44691 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 12 16:42:44 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:44 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:44.274638 6985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:44.269909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:45103)
0812 16:42:44.270064 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:44.270076 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:44.270146 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:44.270267 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:44.270268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:44.270438 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:44.270487 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:44.270489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.271195 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.271196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:44.271758 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:44.271759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.272102 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.272103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:44.272142 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:44.272716 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:44.272722 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:44.274551 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
W20260812 16:42:44.274739 6978 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:44.269972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:45103 (local address 127.21.114.126:46863)
0812 16:42:44.270046 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:44.270049 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:44.270130 (+ 81us) server_negotiation.cc:407] Connection header received
0812 16:42:44.270201 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:44.270202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:44.270213 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:44.270256 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:44.270543 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.271100 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.271848 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:44.272030 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:44.272092 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:44.274664 (+ 2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:45103: BlockingRecv error: recv got EOF from 127.21.114.67:45103 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 16:42:45 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:45 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:45.005735 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:45.000456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:32953)
0812 16:42:45.000638 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:45.000649 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:45.000715 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:45.000908 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:45.000909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:45.001224 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:45.001320 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:45.001323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.002138 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.002139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:45.002716 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:45.002718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.003062 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.003063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:45.003109 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:45.003575 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:45.003580 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:45.005669 (+ 2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":119,"threads_started":1}
W20260812 16:42:45.005818 6989 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:45.000538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:32953 (local address 127.21.114.126:46863)
0812 16:42:45.000662 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:45.000664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:45.000718 (+ 54us) server_negotiation.cc:407] Connection header received
0812 16:42:45.000773 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:45.000773 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:45.000785 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:45.000841 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:45.001432 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.002051 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.002803 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.002996 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.003046 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:45.005760 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:32953: BlockingRecv error: recv got EOF from 127.21.114.65:32953 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
Aug 12 16:42:45 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:45 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:45.130827 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:45.126292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:48009)
0812 16:42:45.126465 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:45.126477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:45.126541 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:45.126678 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:45.126678 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:45.126864 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:45.126916 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:45.126917 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.127566 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.127567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:45.128088 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:45.128089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.128520 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.128521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:45.128563 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:45.128999 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:45.129003 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:45.130765 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":112,"threads_started":1}
W20260812 16:42:45.130962 6989 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:45.126414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:48009 (local address 127.21.114.126:46863)
0812 16:42:45.126495 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:45.126497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:45.126529 (+ 32us) server_negotiation.cc:407] Connection header received
0812 16:42:45.126601 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:45.126602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:45.126612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:45.126656 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:45.126988 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.127498 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.128175 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.128453 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.128512 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:45.130879 (+ 2367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:48009: BlockingRecv error: recv got EOF from 127.21.114.66:48009 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 16:42:45 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:45 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:45.279992 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:45.275082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:56109)
0812 16:42:45.275313 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:45.275324 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:45.275419 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:45.275587 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:45.275589 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:45.275807 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:45.275859 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:45.275860 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.276603 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.276604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:45.277166 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:45.277168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.277541 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.277542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:45.277614 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:45.278133 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:45.278139 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:45.279931 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":110,"threads_started":1}
W20260812 16:42:45.280128 6989 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:45.275181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:56109 (local address 127.21.114.126:46863)
0812 16:42:45.275293 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:45.275296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:45.275397 (+ 101us) server_negotiation.cc:407] Connection header received
0812 16:42:45.275496 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:45.275501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:45.275514 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:45.275577 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:45.275943 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.276519 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.277262 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:45.277461 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:45.277542 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:45.280023 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:56109: BlockingRecv error: recv got EOF from 127.21.114.67:56109 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 16:42:46 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:46 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:46.011734 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:46.006332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:36197)
0812 16:42:46.006562 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:46.006574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:46.006632 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:46.006778 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:46.006778 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:46.006958 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:46.007010 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:46.007011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.007883 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.007885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:46.008620 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:46.008623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.008988 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.008989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:46.009036 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:46.009583 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:46.009588 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:46.011621 (+ 2033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":138,"threads_started":1}
W20260812 16:42:46.011792 6999 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:46.006487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:36197 (local address 127.21.114.126:46863)
0812 16:42:46.006621 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:46.006623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:46.006640 (+ 17us) server_negotiation.cc:407] Connection header received
0812 16:42:46.006686 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:46.006687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:46.006698 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:46.006763 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:46.007093 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.007771 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.008700 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.008916 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.008977 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:46.011715 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:36197: BlockingRecv error: recv got EOF from 127.21.114.65:36197 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
Aug 12 16:42:46 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:46 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:46.136018 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:46.131299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:55593)
0812 16:42:46.131458 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:46.131469 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:46.131536 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:46.131663 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:46.131663 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:46.131874 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:46.131925 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:46.131926 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.132786 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.132787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:46.133341 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:46.133342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.133665 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.133666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:46.133706 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:46.134185 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:46.134189 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:46.135955 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
W20260812 16:42:46.136176 6999 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:46.131380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:55593 (local address 127.21.114.126:46863)
0812 16:42:46.131468 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:46.131470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:46.131534 (+ 64us) server_negotiation.cc:407] Connection header received
0812 16:42:46.131583 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:46.131583 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:46.131594 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:46.131645 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:46.131999 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.132677 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.133418 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.133601 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.133652 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:46.136088 (+ 2436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:55593: BlockingRecv error: recv got EOF from 127.21.114.66:55593 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 16:42:46 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:46 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:46.284930 7002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:46.280447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:49873)
0812 16:42:46.280610 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:46.280626 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:46.280691 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:46.280819 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:46.280820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:46.280984 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:46.281034 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:46.281035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.281678 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.281679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:46.282235 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:46.282237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.282565 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.282565 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:46.282614 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:46.283045 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:46.283050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:46.284872 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":117,"threads_started":1}
W20260812 16:42:46.285087 6999 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:46.280524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:49873 (local address 127.21.114.126:46863)
0812 16:42:46.280593 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:46.280595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:46.280691 (+ 96us) server_negotiation.cc:407] Connection header received
0812 16:42:46.280742 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:46.280743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:46.280758 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:46.280813 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:46.281119 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.281607 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.282312 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:46.282499 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:46.282552 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:46.284997 (+ 2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:49873: BlockingRecv error: recv got EOF from 127.21.114.67:49873 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 16:42:47 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:47 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:47.021369 7003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:47.012222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:49413)
0812 16:42:47.012387 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:47.012403 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:47.012470 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:47.012695 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:47.012696 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:47.012896 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:47.012948 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:47.012950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.013643 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.013644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:47.014191 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:47.014193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.014606 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.014607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:47.014674 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:47.019059 (+ 4385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:47.019064 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:47.021257 (+ 2193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":94,"threads_started":1}
W20260812 16:42:47.021414 7005 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:47.012356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:49413 (local address 127.21.114.126:46863)
0812 16:42:47.012531 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:47.012533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:47.012561 (+ 28us) server_negotiation.cc:407] Connection header received
0812 16:42:47.012588 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:47.012591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:47.012607 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:47.012684 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:47.013034 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.013556 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.014310 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.014527 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.014608 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:47.021339 (+ 6731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:49413: BlockingRecv error: recv got EOF from 127.21.114.65:49413 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
Aug 12 16:42:47 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:47 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:47.141311 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:47.136473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:35047)
0812 16:42:47.136661 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:47.136671 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:47.136725 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:47.136851 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:47.136851 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:47.137032 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:47.137084 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:47.137085 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.137710 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.137711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:47.138270 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:47.138271 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.138641 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.138642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:47.138698 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:47.139216 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:47.139221 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:47.141221 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":77,"threads_started":1}
W20260812 16:42:47.141429 7005 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:47.136561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:35047 (local address 127.21.114.126:46863)
0812 16:42:47.136649 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:47.136652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:47.136735 (+ 83us) server_negotiation.cc:407] Connection header received
0812 16:42:47.136779 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:47.136779 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:47.136791 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:47.136833 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:47.137148 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.137638 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.138346 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.138542 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.138599 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:47.141331 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:35047: BlockingRecv error: recv got EOF from 127.21.114.66:35047 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 16:42:47 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:47 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:47.290220 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:47.285372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:44989)
0812 16:42:47.285572 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:47.285584 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:47.285678 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:47.285809 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:47.285810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:47.286024 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:47.286073 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:47.286075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.286847 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.286847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:47.287352 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:47.287353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.287720 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.287721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:47.287791 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:47.288360 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:47.288371 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:47.290161 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":100,"threads_started":1}
W20260812 16:42:47.290357 7005 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:47.285476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:44989 (local address 127.21.114.126:46863)
0812 16:42:47.285552 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:47.285554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:47.285654 (+ 100us) server_negotiation.cc:407] Connection header received
0812 16:42:47.285733 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:47.285734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:47.285749 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:47.285794 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:47.286156 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.286682 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.287436 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:47.287637 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:47.287708 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:47.290251 (+ 2543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:44989: BlockingRecv error: recv got EOF from 127.21.114.67:44989 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 16:42:48 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:48 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:48.027390 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:48.021906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:50991)
0812 16:42:48.022107 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:48.022122 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:48.022226 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:48.022445 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:48.022446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:48.022691 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:48.022745 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:48.022747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.023478 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.023479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:48.024133 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:48.024135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.024606 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.024607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:48.024657 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:48.025263 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:48.025272 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:48.027287 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":103,"threads_started":1}
W20260812 16:42:48.027451 7012 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:48.022003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:50991 (local address 127.21.114.126:46863)
0812 16:42:48.022146 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:48.022148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:48.022188 (+ 40us) server_negotiation.cc:407] Connection header received
0812 16:42:48.022329 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:48.022330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:48.022346 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:48.022430 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:48.022867 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.023384 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.024224 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.024533 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.024594 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:48.027369 (+ 2775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:50991: BlockingRecv error: recv got EOF from 127.21.114.65:50991 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
Aug 12 16:42:48 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:48 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:48.146924 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:48.141850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:60337)
0812 16:42:48.142037 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:48.142051 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:48.142158 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:48.142341 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:48.142342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:48.142547 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:48.142597 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:48.142598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.143398 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.143400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:48.143987 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:48.143989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.144490 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.144491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:48.144567 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:48.145024 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:48.145029 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:48.146861 (+ 1832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":92,"threads_started":1}
W20260812 16:42:48.147078 7012 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:48.141929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:60337 (local address 127.21.114.126:46863)
0812 16:42:48.142037 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:48.142040 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:48.142141 (+ 101us) server_negotiation.cc:407] Connection header received
0812 16:42:48.142265 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:48.142266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:48.142279 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:48.142334 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:48.142693 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.143299 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.144092 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.144403 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.144493 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:48.146984 (+ 2491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:60337: BlockingRecv error: recv got EOF from 127.21.114.66:60337 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 16:42:48 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:48 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:48.295684 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:48.290732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:45497)
0812 16:42:48.290903 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:48.290919 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:48.290983 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:48.291147 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:48.291148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:48.291326 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:48.291421 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:48.291423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.292231 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.292233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:48.292932 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:48.292935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.293321 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.293322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:48.293368 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:48.293827 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:48.293832 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:48.295619 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":108,"threads_started":1}
W20260812 16:42:48.295763 7012 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:48.290852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:45497 (local address 127.21.114.126:46863)
0812 16:42:48.290900 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:48.290902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:48.290981 (+ 79us) server_negotiation.cc:407] Connection header received
0812 16:42:48.291038 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:48.291039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:48.291050 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:48.291107 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:48.291498 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.292139 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.293011 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:48.293222 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:48.293320 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:48.295714 (+ 2394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:45497: BlockingRecv error: recv got EOF from 127.21.114.67:45497 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 16:42:49 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:49 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:49.032788 7019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:49.027938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:46753)
0812 16:42:49.028107 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:49.028118 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:49.028175 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:49.028367 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:49.028368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:49.028558 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:49.028611 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:49.028612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.029271 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.029272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:49.029782 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:49.029783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.030145 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.030145 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:49.030191 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:49.030708 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:49.030712 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:49.032659 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
W20260812 16:42:49.032907 7022 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:49.028045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:46753 (local address 127.21.114.126:46863)
0812 16:42:49.028169 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:49.028173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:49.028206 (+ 33us) server_negotiation.cc:407] Connection header received
0812 16:42:49.028228 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:49.028229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:49.028240 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:49.028292 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:49.028679 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.029202 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.029870 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.030076 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.030126 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:49.032796 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:46753: BlockingRecv error: recv got EOF from 127.21.114.65:46753 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
Aug 12 16:42:49 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:49 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:49.152544 7023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:49.147435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:58869)
0812 16:42:49.147661 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:49.147682 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:49.147744 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:49.147935 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:49.147937 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:49.148114 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:49.148166 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:49.148167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.148868 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.148869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:49.149419 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:49.149421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.149809 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.149810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:49.149865 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:49.150385 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:49.150390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:49.152465 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":162,"threads_started":1}
W20260812 16:42:49.152626 7022 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:49.147558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:58869 (local address 127.21.114.126:46863)
0812 16:42:49.147668 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:49.147670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:49.147729 (+ 59us) server_negotiation.cc:407] Connection header received
0812 16:42:49.147833 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:49.147834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:49.147845 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:49.147897 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:49.148256 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.148772 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.149504 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.149705 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.149765 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:49.152569 (+ 2804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:58869: BlockingRecv error: recv got EOF from 127.21.114.66:58869 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 16:42:49 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:49 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:49.301373 7029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:49.296334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:42729)
0812 16:42:49.296549 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:49.296567 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:49.296651 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:49.296809 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:49.296809 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:49.297005 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:49.297055 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:49.297057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.297737 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.297738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:49.298276 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:49.298278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.298679 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.298680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:49.298750 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:49.299266 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:49.299271 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:49.301313 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":107,"threads_started":1}
W20260812 16:42:49.301522 7022 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:49.296414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:42729 (local address 127.21.114.126:46863)
0812 16:42:49.296520 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:49.296522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:49.296633 (+ 111us) server_negotiation.cc:407] Connection header received
0812 16:42:49.296729 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:49.296730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:49.296744 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:49.296792 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:49.297137 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.297648 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.298388 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:49.298589 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:49.298677 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:49.301423 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:42729: BlockingRecv error: recv got EOF from 127.21.114.67:42729 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 16:42:50 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:50 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:50.038594 7033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:50.033365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:41133)
0812 16:42:50.033538 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:50.033552 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:50.033622 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:50.033889 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:50.033890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:50.034153 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:50.034219 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:50.034222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.034928 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.034929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:50.035456 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:50.035458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.035874 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.035874 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:50.035913 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:50.036543 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:50.036548 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:50.038526 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":100,"threads_started":1}
W20260812 16:42:50.038710 7042 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:50.033517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:41133 (local address 127.21.114.126:46863)
0812 16:42:50.033681 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:50.033683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:50.033693 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:42:50.033719 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:50.033720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:50.033754 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:50.033828 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:50.034320 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.034855 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.035561 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.035800 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.035866 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:50.038623 (+ 2757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:41133: BlockingRecv error: recv got EOF from 127.21.114.65:41133 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
Aug 12 16:42:50 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:50 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:50.158141 7043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:50.153162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:51903)
0812 16:42:50.153389 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:50.153402 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:50.153473 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:50.153679 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:50.153680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:50.153949 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:50.154006 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:50.154009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.154670 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.154671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:50.155283 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:50.155285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.155671 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.155672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:50.155713 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:50.156207 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:50.156213 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:50.158080 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":150,"threads_started":1}
W20260812 16:42:50.158289 7042 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:50.153338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51903 (local address 127.21.114.126:46863)
0812 16:42:50.153396 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:50.153399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:50.153474 (+ 75us) server_negotiation.cc:407] Connection header received
0812 16:42:50.153553 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:50.153554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:50.153567 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:50.153635 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:50.154090 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.154600 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.155356 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.155602 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.155661 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:50.158189 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:51903: BlockingRecv error: recv got EOF from 127.21.114.66:51903 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 12 16:42:50 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:50 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:50.307164 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:50.301930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:55315)
0812 16:42:50.302108 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:50.302120 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:50.302189 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:50.302370 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:50.302371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:50.302544 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:50.302624 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:50.302626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.303317 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.303318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:50.303953 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:50.303956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.304440 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.304440 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:50.304493 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:50.305046 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:50.305054 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:50.307104 (+ 2050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":119,"threads_started":1}
W20260812 16:42:50.307298 7042 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:50.302061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:55315 (local address 127.21.114.126:46863)
0812 16:42:50.302133 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:50.302135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:50.302188 (+ 53us) server_negotiation.cc:407] Connection header received
0812 16:42:50.302259 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:50.302260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:50.302272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:50.302320 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:50.302736 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.303237 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.304054 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:50.304289 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:50.304440 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:50.307213 (+ 2773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:55315: BlockingRecv error: recv got EOF from 127.21.114.67:55315 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 16:42:51 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:51 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:51.044436 7045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:51.039178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:35621)
0812 16:42:51.039417 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:51.039430 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:51.039505 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:51.039658 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:51.039659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:51.039851 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:51.039905 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:51.039906 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.040662 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.040663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:51.041226 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:51.041228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.041684 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.041685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:51.041769 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:51.042271 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:51.042277 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:51.044325 (+ 2048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":128,"threads_started":1}
W20260812 16:42:51.044539 7046 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:51.039286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:35621 (local address 127.21.114.126:46863)
0812 16:42:51.039421 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:51.039423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:51.039483 (+ 60us) server_negotiation.cc:407] Connection header received
0812 16:42:51.039552 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:51.039553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:51.039563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:51.039648 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:51.040011 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.040584 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.041314 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.041588 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.041649 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:51.044448 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:35621: BlockingRecv error: recv got EOF from 127.21.114.65:35621 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
Aug 12 16:42:51 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:51 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:51.163970 7048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:51.158696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:50299)
0812 16:42:51.158876 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:51.158890 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:51.158971 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:51.159143 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:51.159144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:51.159346 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:51.159414 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:51.159416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.160086 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.160087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:51.160706 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:51.160708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.161110 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.161111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:51.161163 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:51.161785 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:51.161790 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:51.163909 (+ 2119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":75,"threads_started":1}
W20260812 16:42:51.164132 7046 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:51.158853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:50299 (local address 127.21.114.126:46863)
0812 16:42:51.158922 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:51.158924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:51.158953 (+ 29us) server_negotiation.cc:407] Connection header received
0812 16:42:51.159052 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:51.159053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:51.159064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:51.159106 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:51.159484 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.160003 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.160837 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.161031 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.161086 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:51.164035 (+ 2949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:50299: BlockingRecv error: recv got EOF from 127.21.114.66:50299 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 16:42:51 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:51 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:51.312567 7049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:51.307626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:58235)
0812 16:42:51.307834 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:51.307845 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:51.307930 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:51.308084 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:51.308085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:51.308278 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:51.308371 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:51.308373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.309076 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.309077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:51.309622 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:51.309624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.309998 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.310000 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:51.310092 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:51.310520 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:51.310524 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:51.312471 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":107,"threads_started":1}
W20260812 16:42:51.312608 7046 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:51.307716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:58235 (local address 127.21.114.126:46863)
0812 16:42:51.307786 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:51.307788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:51.307909 (+ 121us) server_negotiation.cc:407] Connection header received
0812 16:42:51.308010 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:51.308011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:51.308025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:51.308078 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:51.308464 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.308981 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.309710 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:51.309921 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:51.310001 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:51.312547 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:58235: BlockingRecv error: recv got EOF from 127.21.114.67:58235 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 16:42:52 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:52 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:52.053606 7051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:52.045016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:39533)
0812 16:42:52.045168 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:52.045187 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:52.045235 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:52.045376 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:52.045376 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:52.045553 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:52.045603 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:52.045604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.046280 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.046281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:52.046806 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:52.046808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.047169 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.047170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:52.047223 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:52.051276 (+ 4053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:52.051282 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:52.053504 (+ 2222us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
W20260812 16:42:52.053668 7053 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:52.045094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:39533 (local address 127.21.114.126:46863)
0812 16:42:52.045239 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:52.045241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:52.045252 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:52.045282 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:52.045283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:52.045293 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:52.045370 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:52.045668 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.046182 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.046884 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.047074 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.047127 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:52.053592 (+ 6465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:39533: BlockingRecv error: recv got EOF from 127.21.114.65:39533 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
Aug 12 16:42:52 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:52 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:52.169479 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:52.164528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:41169)
0812 16:42:52.164703 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:52.164725 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:52.164814 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:52.165028 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:52.165029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:52.165208 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:52.165258 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:52.165260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.165921 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.165922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:52.166474 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:52.166475 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.166827 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.166828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:52.166866 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:52.167376 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:52.167382 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:52.169405 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":118,"threads_started":1}
W20260812 16:42:52.169615 7053 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:52.164643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:41169 (local address 127.21.114.126:46863)
0812 16:42:52.164693 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:52.164695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:52.164865 (+ 170us) server_negotiation.cc:407] Connection header received
0812 16:42:52.164932 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:52.164933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:52.164947 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:52.164996 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:52.165335 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.165844 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.166550 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.166759 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.166821 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:52.169525 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:41169: BlockingRecv error: recv got EOF from 127.21.114.66:41169 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 16:42:52 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:52 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.67@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:52.318216 7056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:52.313102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.67:47311)
0812 16:42:52.313335 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:52.313347 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:52.313437 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:52.313603 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:52.313604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:52.313797 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:52.313849 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:52.313851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.314548 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.314550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:52.315087 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:52.315089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.315478 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.315479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:52.315549 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:52.316016 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:52.316021 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:52.318114 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":111,"threads_started":1}
W20260812 16:42:52.318257 7053 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:52.313202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:47311 (local address 127.21.114.126:46863)
0812 16:42:52.313276 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:52.313281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:52.313423 (+ 142us) server_negotiation.cc:407] Connection header received
0812 16:42:52.313506 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:52.313507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:52.313522 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:52.313595 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:52.313937 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.314445 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.315178 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:52.315390 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:52.315479 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:52.318195 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.67:47311: BlockingRecv error: recv got EOF from 127.21.114.67:47311 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 16:42:53 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:53 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.65@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:53.059226 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.054188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.65:57545)
0812 16:42:53.054371 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:53.054382 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:53.054444 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:53.054588 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:53.054588 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:53.054769 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:53.054824 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.054826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.055556 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.055557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.056097 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.056099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.056522 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.056524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.056622 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.057160 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:53.057165 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:53.059124 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":139,"threads_started":1}
W20260812 16:42:53.059288 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:53.054283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:57545 (local address 127.21.114.126:46863)
0812 16:42:53.054400 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.054402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.054429 (+ 27us) server_negotiation.cc:407] Connection header received
0812 16:42:53.054502 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.054503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.054514 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.054570 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.054893 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.055471 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.056190 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.056441 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.056521 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.059212 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.65:57545: BlockingRecv error: recv got EOF from 127.21.114.65:57545 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
Aug 12 16:42:53 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 16:42:53 dist-test-slave-45dx krb5kdc[5087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.114.66@KRBTEST.COM for oryx/127.21.114.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 16:42:53.174901 7061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.170108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:46863 (local address 127.21.114.66:57365)
0812 16:42:53.170284 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:53.170298 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:53.170367 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:53.170552 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:53.170553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:53.170815 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:53.170868 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.170870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.171516 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.171517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.172100 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.172102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.172556 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.172557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.172602 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.173067 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:53.173072 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:53.174841 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.114.126:46863: Server oryx/127.21.114.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
W20260812 16:42:53.175035 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:53.170221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:57365 (local address 127.21.114.126:46863)
0812 16:42:53.170318 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.170320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.170349 (+ 29us) server_negotiation.cc:407] Connection header received
0812 16:42:53.170453 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.170454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.170467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.170518 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.170935 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.171444 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.172211 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.172487 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.172545 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.174948 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.114.66:57365: BlockingRecv error: recv got EOF from 127.21.114.66:57365 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 16:42:53.233994 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 6146
I20260812 16:42:53.252175 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 6435
I20260812 16:42:53.263711 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 6696
I20260812 16:42:53.275442 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 6026
2026-08-12T16:42:53Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17859 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T16:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:53Z Disabled control of system clock
I20260812 16:42:53.309327 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:43769
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:43769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 16:42:53.392227 7068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:53.392457 7068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:53.392477 7068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:53.393724 7068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:53.393766 7068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:53.393779 7068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:53.393792 7068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:53.393805 7068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:53.395185 7068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:43769
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:43769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:53.395448 7068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:53.395761 7068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:53.400547 7077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:53.400580 7078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:53.400579 7080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:53.400869 7068 server_base.cc:1034] running on GCE node
I20260812 16:42:53.401198 7068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:53.401521 7068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:53.402709 7068 hybrid_clock.cc:648] HybridClock initialized: now 1786552973402668 us; error 52 us; skew 500 ppm
I20260812 16:42:53.404040 7068 webserver.cc:460] Webserver started at http://127.21.114.126:42261/ using document root <none> and password file <none>
I20260812 16:42:53.404351 7068 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:53.404422 7068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:53.404568 7068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:53.405648 7068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "35927dc6c4a1419bb9f5f5edaa3773a2"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "8cf2b0f415b97f8b5b161be8fab57c4f"
server_key_iv: "e64507d0e269e8c8794b4796d2ec0364"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.406044 7068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "35927dc6c4a1419bb9f5f5edaa3773a2"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "8cf2b0f415b97f8b5b161be8fab57c4f"
server_key_iv: "e64507d0e269e8c8794b4796d2ec0364"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.407325 7068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:53.408089 7089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.408280 7068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:53.408401 7068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "35927dc6c4a1419bb9f5f5edaa3773a2"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "8cf2b0f415b97f8b5b161be8fab57c4f"
server_key_iv: "e64507d0e269e8c8794b4796d2ec0364"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.408488 7068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:53.422302 7068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:53.422590 7068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:53.422741 7068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:53.426839 7068 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:43769
I20260812 16:42:53.426877 7181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:43769 every 8 connection(s)
I20260812 16:42:53.427208 7068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:53.427889 7182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:53.430600 7182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2: Bootstrap starting.
I20260812 16:42:53.431275 7182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:53.431581 7182 log.cc:824] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:53.432348 7182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2: No bootstrap required, opened a new log
I20260812 16:42:53.434021 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 7068
I20260812 16:42:53.434134 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:53.434108 7182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43769 } }
I20260812 16:42:53.434289 7182 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:53.434327 7182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35927dc6c4a1419bb9f5f5edaa3773a2, State: Initialized, Role: FOLLOWER
I20260812 16:42:53.434360 21961 external_mini_cluster.cc:1428] Setting key a6d89ade3f9355a1713c31c2d09f5665
I20260812 16:42:53.434484 7182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43769 } }
I20260812 16:42:53.434578 7182 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:53.434603 7182 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:53.434674 7182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:53.435447 7182 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43769 } }
I20260812 16:42:53.435562 7182 leader_election.cc:302] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35927dc6c4a1419bb9f5f5edaa3773a2; no voters:
I20260812 16:42:53.435709 7182 leader_election.cc:288] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:53.435752 7192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:53.435981 7192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [term 1 LEADER]: Becoming Leader. State: Replica: 35927dc6c4a1419bb9f5f5edaa3773a2, State: Running, Role: LEADER
I20260812 16:42:53.436069 7182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:53.436147 7192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43769 } }
I20260812 16:42:53.436710 7195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35927dc6c4a1419bb9f5f5edaa3773a2. Latest consensus state: current_term: 1 leader_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43769 } } }
I20260812 16:42:53.436796 7195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:53.436723 7194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35927dc6c4a1419bb9f5f5edaa3773a2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 43769 } } }
I20260812 16:42:53.437071 7194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:53.437498 7216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:53.438123 7216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:53.440083 7216 catalog_manager.cc:1347] Generated new cluster ID: 06a937e621fc4f86a2972c4284e51a05
I20260812 16:42:53.440136 7216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:53.441010 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.435087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49114 (local address 127.21.114.126:43769)
0812 16:42:53.435319 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.435336 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.435371 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:42:53.435489 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.435496 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.435570 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.435730 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.436068 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.437946 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.438839 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.439452 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.439576 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.440277 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:53.440295 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:53.440295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:53.440510 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:53.440543 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:53.440554 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:53.440629 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:53.440714 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 16:42:53.440813 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
I20260812 16:42:53.451064 7216 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:53.451584 7216 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:53.453974 7216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35927dc6c4a1419bb9f5f5edaa3773a2: Generated new TSK 0
I20260812 16:42:53.454145 7216 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:53.461468 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43769
--builtin_ntp_servers=127.21.114.84:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 16:42:53.553874 7232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:53.554082 7232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:53.554104 7232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:53.555264 7232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:53.555310 7232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:53.555335 7232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:53.556744 7232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:53.556986 7232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:53.557303 7232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:53.563656 7246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:53.563786 7232 server_base.cc:1034] running on GCE node
W20260812 16:42:53.563675 7245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:53.563656 7249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:53.564073 7232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:53.564373 7232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:53.565560 7232 hybrid_clock.cc:648] HybridClock initialized: now 1786552973565538 us; error 30 us; skew 500 ppm
I20260812 16:42:53.566978 7232 webserver.cc:460] Webserver started at http://127.21.114.65:37409/ using document root <none> and password file <none>
I20260812 16:42:53.567221 7232 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:53.567276 7232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:53.567408 7232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:53.568825 7232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "d1e08d45a0b94bfa8724cd22f34f71ff"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "06da9a752ea11177f8813d3d1618c46f"
server_key_iv: "75b7e75daf3f38a4604caffe4c75e66a"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.569268 7232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "d1e08d45a0b94bfa8724cd22f34f71ff"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "06da9a752ea11177f8813d3d1618c46f"
server_key_iv: "75b7e75daf3f38a4604caffe4c75e66a"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.570591 7232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 16:42:53.571305 7264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.571507 7232 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:53.571614 7232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "d1e08d45a0b94bfa8724cd22f34f71ff"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "06da9a752ea11177f8813d3d1618c46f"
server_key_iv: "75b7e75daf3f38a4604caffe4c75e66a"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.571704 7232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:53.581869 7232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:53.582170 7232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:53.582329 7232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:53.582566 7232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:53.582894 7232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:53.582952 7232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.582990 7232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:53.583017 7232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.589061 7232 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:42543
I20260812 16:42:53.589102 7468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:42543 every 8 connection(s)
I20260812 16:42:53.589448 7232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:53.594633 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.590228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:40333 (local address 127.21.114.126:43769)
0812 16:42:53.590292 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.590294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.590520 (+ 226us) server_negotiation.cc:407] Connection header received
0812 16:42:53.591005 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.591005 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.591018 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.591080 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.591766 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.592274 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.593302 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.593492 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.593546 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.594400 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:53.594400 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:53.594401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:53.594404 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:53.594415 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:53.594419 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:53.594457 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:53.594545 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 16:42:53.594572 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:42:53.594821 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.590175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43769 (local address 127.21.114.65:40333)
0812 16:42:53.590389 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:53.590429 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:53.590913 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:53.591168 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:53.591171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:53.591179 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:53.591676 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.591680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.592433 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.592434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.593221 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.593224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.593570 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.593571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.593682 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.594258 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:53.594259 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:53.594299 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:53.594323 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:53.594472 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:53.594478 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:53.594480 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:53.594532 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:42:53.594614 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260812 16:42:53.595415 7469 heartbeater.cc:347] Connected to a master server at 127.21.114.126:43769
I20260812 16:42:53.595520 7469 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:53.595698 7469 heartbeater.cc:511] Master 127.21.114.126:43769 requested a full tablet report, sending...
I20260812 16:42:53.596426 7114 ts_manager.cc:194] Registered new tserver with Master: d1e08d45a0b94bfa8724cd22f34f71ff (127.21.114.65:42543)
I20260812 16:42:53.597126 7114 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.65:40333
I20260812 16:42:53.599141 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 7232
I20260812 16:42:53.599298 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:53.599647 21961 external_mini_cluster.cc:1428] Setting key 2cf0b05f048b3b5dd2ab17173c32ee45
I20260812 16:42:53.600870 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43769
--builtin_ntp_servers=127.21.114.84:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 16:42:53.685307 7479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:53.685513 7479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:53.685534 7479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:53.686684 7479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:53.686728 7479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:53.686753 7479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:53.688136 7479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:53.688407 7479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:53.688728 7479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:53.693812 7488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:53.693962 7479 server_base.cc:1034] running on GCE node
W20260812 16:42:53.693787 7495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:53.693794 7490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:53.694260 7479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:53.694537 7479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:53.695735 7479 hybrid_clock.cc:648] HybridClock initialized: now 1786552973695713 us; error 30 us; skew 500 ppm
I20260812 16:42:53.697094 7479 webserver.cc:460] Webserver started at http://127.21.114.66:34297/ using document root <none> and password file <none>
I20260812 16:42:53.697336 7479 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:53.697408 7479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:53.697564 7479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:53.698652 7479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "9327302b32c84a01bcbcfa9d3754298a"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "afd474f64e60080e46682e7c55336b49"
server_key_iv: "bb584e8819f486891c25b346e3b7e43e"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.699112 7479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "9327302b32c84a01bcbcfa9d3754298a"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "afd474f64e60080e46682e7c55336b49"
server_key_iv: "bb584e8819f486891c25b346e3b7e43e"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.700480 7479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:53.701220 7503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.701388 7479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:42:53.701496 7479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "9327302b32c84a01bcbcfa9d3754298a"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "afd474f64e60080e46682e7c55336b49"
server_key_iv: "bb584e8819f486891c25b346e3b7e43e"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.701573 7479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:53.712872 7479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:53.713174 7479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:53.713328 7479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:53.713563 7479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:53.713907 7479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:53.713963 7479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.714005 7479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:53.714033 7479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.719956 7479 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:45647
I20260812 16:42:53.720059 7722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:45647 every 8 connection(s)
I20260812 16:42:53.720440 7479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:53.725724 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.721210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:38811 (local address 127.21.114.126:43769)
0812 16:42:53.721260 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.721262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.721496 (+ 234us) server_negotiation.cc:407] Connection header received
0812 16:42:53.722018 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.722019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.722028 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.722090 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.722740 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.723251 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.724215 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.724517 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.724580 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.725485 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:53.725487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:53.725487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:53.725491 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:53.725506 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:53.725510 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:53.725555 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:53.725636 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 16:42:53.725658 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:53.725907 7728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.721168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43769 (local address 127.21.114.66:38811)
0812 16:42:53.721365 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:53.721406 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:53.721929 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:53.722149 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:53.722152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:53.722161 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:53.722651 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.722655 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.723333 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.723334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.724130 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.724132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.724597 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.724598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.724711 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.725353 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:53.725354 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:53.725382 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:53.725405 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:53.725566 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:53.725570 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:53.725573 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:53.725625 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:42:53.725703 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260812 16:42:53.726413 7723 heartbeater.cc:347] Connected to a master server at 127.21.114.126:43769
I20260812 16:42:53.726498 7723 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:53.726636 7723 heartbeater.cc:511] Master 127.21.114.126:43769 requested a full tablet report, sending...
I20260812 16:42:53.726967 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 7479
I20260812 16:42:53.727028 7114 ts_manager.cc:194] Registered new tserver with Master: 9327302b32c84a01bcbcfa9d3754298a (127.21.114.66:45647)
I20260812 16:42:53.727063 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:53.727264 21961 external_mini_cluster.cc:1428] Setting key 85fe5edc644a22246c4204567f194163
I20260812 16:42:53.727495 7114 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.66:38811
I20260812 16:42:53.728370 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43769
--builtin_ntp_servers=127.21.114.84:43803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 16:42:53.813205 7730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:53.813429 7730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:53.813452 7730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:53.814599 7730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:53.814642 7730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:53.814666 7730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:53.815999 7730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:43769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:53.816256 7730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:53.816598 7730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:53.821799 7750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:53.821869 7744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:53.821857 7743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:53.822068 7730 server_base.cc:1034] running on GCE node
I20260812 16:42:53.822300 7730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:53.822551 7730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:53.823716 7730 hybrid_clock.cc:648] HybridClock initialized: now 1786552973823711 us; error 34 us; skew 500 ppm
I20260812 16:42:53.825124 7730 webserver.cc:460] Webserver started at http://127.21.114.67:41989/ using document root <none> and password file <none>
I20260812 16:42:53.825407 7730 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:53.825455 7730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:53.825603 7730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:53.826700 7730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "c3eff647bdc54017bb1336bfb13696ae"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "2d50cb3c32070161c17f9d86e005146a"
server_key_iv: "7d6718814451a839ba7d61f12268de58"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.827083 7730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "c3eff647bdc54017bb1336bfb13696ae"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "2d50cb3c32070161c17f9d86e005146a"
server_key_iv: "7d6718814451a839ba7d61f12268de58"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.828475 7730 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:53.829233 7759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.829448 7730 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:53.829556 7730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "c3eff647bdc54017bb1336bfb13696ae"
format_stamp: "Formatted at 2026-08-12 16:42:53 on dist-test-slave-45dx"
server_key: "2d50cb3c32070161c17f9d86e005146a"
server_key_iv: "7d6718814451a839ba7d61f12268de58"
server_key_version: "encryptionkey@0"
I20260812 16:42:53.829633 7730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:53.859488 7730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:53.859861 7730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:53.860029 7730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:53.860286 7730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:53.860895 7730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:53.860946 7730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.860981 7730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:53.861002 7730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:53.867143 7730 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:41893
I20260812 16:42:53.867206 7964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:41893 every 8 connection(s)
I20260812 16:42:53.867550 7730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:53.873006 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.868386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:55395 (local address 127.21.114.126:43769)
0812 16:42:53.868463 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.868466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.868718 (+ 252us) server_negotiation.cc:407] Connection header received
0812 16:42:53.869245 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.869246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.869259 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.869317 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.869994 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.870486 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.871493 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.871690 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.871754 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.872746 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:53.872747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:53.872748 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:53.872753 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:53.872769 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:53.872774 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:53.872820 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:53.872922 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 16:42:53.872946 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:53.873188 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:53.868357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:43769 (local address 127.21.114.67:55395)
0812 16:42:53.868587 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:53.868625 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:53.869142 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:53.869374 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:53.869377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:53.869385 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:53.869910 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.869914 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.870578 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.870579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.871409 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:53.871411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:53.871767 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:53.871768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:53.871899 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:53.872611 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:53.872612 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:53.872641 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:53.872665 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:53.872851 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:53.872855 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:53.872857 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:42:53.872910 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 16:42:53.872989 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":118,"threads_started":1}
I20260812 16:42:53.873688 7966 heartbeater.cc:347] Connected to a master server at 127.21.114.126:43769
I20260812 16:42:53.873806 7966 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:53.874017 7966 heartbeater.cc:511] Master 127.21.114.126:43769 requested a full tablet report, sending...
I20260812 16:42:53.874157 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 7730
I20260812 16:42:53.874284 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:53.874445 7112 ts_manager.cc:194] Registered new tserver with Master: c3eff647bdc54017bb1336bfb13696ae (127.21.114.67:41893)
I20260812 16:42:53.874512 21961 external_mini_cluster.cc:1428] Setting key 077ae116182d2b4beb55b7acca2f3e40
I20260812 16:42:53.874951 7112 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.67:55395
I20260812 16:42:53.875468 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 16:42:53.877312 7188 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:53.876795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49120 (local address 127.21.114.126:43769)
0812 16:42:53.876840 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:53.876842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:53.876979 (+ 137us) server_negotiation.cc:407] Connection header received
0812 16:42:53.877054 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:53.877055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:53.877067 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:53.877123 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:53.877252 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49120: BlockingRecv error: recv got EOF from 127.0.0.1:49120 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:42:53.877398 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 7232
I20260812 16:42:53.892850 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 7479
I20260812 16:42:53.912711 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 7730
I20260812 16:42:53.925257 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 7068
2026-08-12T16:42:53Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (648 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T16:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:53Z Disabled control of system clock
I20260812 16:42:53.957974 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37987
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:37179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:37987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 16:42:54.041329 7988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:54.041532 7988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:54.041554 7988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:54.042827 7988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:54.042872 7988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:54.042886 7988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:54.042898 7988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:54.042912 7988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:54.044281 7988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:37987
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:54.044589 7988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:54.044910 7988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:54.050061 8000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:54.050071 7997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:54.050149 8006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:54.050518 7988 server_base.cc:1034] running on GCE node
I20260812 16:42:54.050833 7988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:54.051124 7988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:54.052364 7988 hybrid_clock.cc:648] HybridClock initialized: now 1786552974052361 us; error 45 us; skew 500 ppm
I20260812 16:42:54.053637 7988 webserver.cc:460] Webserver started at http://127.21.114.126:42901/ using document root <none> and password file <none>
I20260812 16:42:54.053956 7988 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:54.054026 7988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:54.054167 7988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:54.055248 7988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "c021700986214ca0a3b28c94573e16f1"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "cb5152ef1ea83ebbecf9ee12c67de6b5"
server_key_iv: "9c7045668bc085a9063af74a302a7533"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.055644 7988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "c021700986214ca0a3b28c94573e16f1"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "cb5152ef1ea83ebbecf9ee12c67de6b5"
server_key_iv: "9c7045668bc085a9063af74a302a7533"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.057125 7988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:54.057962 8021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.058168 7988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:54.058297 7988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "c021700986214ca0a3b28c94573e16f1"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "cb5152ef1ea83ebbecf9ee12c67de6b5"
server_key_iv: "9c7045668bc085a9063af74a302a7533"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.058382 7988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:54.061929 7988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:54.062232 7988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:54.062387 7988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:54.066388 7988 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:37987
I20260812 16:42:54.066432 8102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:37987 every 8 connection(s)
I20260812 16:42:54.066781 7988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:54.067441 8103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:54.070262 8103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1: Bootstrap starting.
I20260812 16:42:54.070845 8103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:54.071151 8103 log.cc:824] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:54.071825 8103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1: No bootstrap required, opened a new log
I20260812 16:42:54.072794 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 7988
I20260812 16:42:54.072930 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:54.073123 21961 external_mini_cluster.cc:1428] Setting key e17b78c534821491c6d3c438ec57cc9f
I20260812 16:42:54.073849 8103 raft_consensus.cc:348] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c021700986214ca0a3b28c94573e16f1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:42:54.074046 8103 raft_consensus.cc:374] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:54.074141 8103 raft_consensus.cc:729] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021700986214ca0a3b28c94573e16f1, State: Initialized, Role: FOLLOWER
I20260812 16:42:54.074290 8103 consensus_queue.cc:260] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c021700986214ca0a3b28c94573e16f1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:42:54.074389 8103 raft_consensus.cc:388] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:54.074435 8103 raft_consensus.cc:482] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:54.074484 8103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:54.075199 8103 raft_consensus.cc:504] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c021700986214ca0a3b28c94573e16f1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:42:54.075313 8103 leader_election.cc:302] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c021700986214ca0a3b28c94573e16f1; no voters:
I20260812 16:42:54.075505 8103 leader_election.cc:288] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:54.075543 8113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:54.075872 8103 sys_catalog.cc:564] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:54.075896 8113 raft_consensus.cc:686] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [term 1 LEADER]: Becoming Leader. State: Replica: c021700986214ca0a3b28c94573e16f1, State: Running, Role: LEADER
I20260812 16:42:54.076007 8113 consensus_queue.cc:237] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c021700986214ca0a3b28c94573e16f1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:42:54.076102 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.073928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.21.114.126:37987)
0812 16:42:54.074201 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:54.074210 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:54.074243 (+ 33us) server_negotiation.cc:407] Connection header received
0812 16:42:54.074366 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:54.074372 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:54.074426 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:54.074569 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:54.075268 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:54.075272 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:54.075272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:54.075276 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:54.075364 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:54.075380 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:54.075464 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:54.075597 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 16:42:54.075659 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":110,"threads_started":1}
I20260812 16:42:54.076442 8116 sys_catalog.cc:455] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c021700986214ca0a3b28c94573e16f1. Latest consensus state: current_term: 1 leader_uuid: "c021700986214ca0a3b28c94573e16f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c021700986214ca0a3b28c94573e16f1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } } }
I20260812 16:42:54.076551 8116 sys_catalog.cc:458] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:54.076925 8114 sys_catalog.cc:455] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c021700986214ca0a3b28c94573e16f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c021700986214ca0a3b28c94573e16f1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } } }
I20260812 16:42:54.076987 8120 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:54.077147 8114 sys_catalog.cc:458] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1 [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:54.077708 8120 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:54.079475 8120 catalog_manager.cc:1347] Generated new cluster ID: 0e55e7ff3ca44461b8db53bdaebca18e
I20260812 16:42:54.079535 8120 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:42:54.103781 8120 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:54.104022 8120 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:54.109228 8120 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c021700986214ca0a3b28c94573e16f1: Generated new TSK 0
I20260812 16:42:54.109447 8120 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:42:54.116771 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--builtin_ntp_servers=127.21.114.84:37179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 16:42:54.202631 8157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:54.202855 8157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:54.202878 8157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:54.204003 8157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:54.204041 8157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:54.204066 8157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:54.205446 8157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:54.205651 8157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:54.205921 8157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:54.211006 8173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:54.211016 8168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:54.211047 8170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:54.211319 8157 server_base.cc:1034] running on GCE node
I20260812 16:42:54.211540 8157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:54.211840 8157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:54.212986 8157 hybrid_clock.cc:648] HybridClock initialized: now 1786552974212978 us; error 30 us; skew 500 ppm
I20260812 16:42:54.214223 8157 webserver.cc:460] Webserver started at http://127.21.114.65:44719/ using document root <none> and password file <none>
I20260812 16:42:54.214455 8157 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:54.214497 8157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:54.214587 8157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:54.215613 8157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "02d7729c43754c2bb108779af00b415b"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "bdce275cc41b056173aabc5ea62de407"
server_key_iv: "a9cdfd0c9c4ea5ce24a0a6974735720f"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.215919 8157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "02d7729c43754c2bb108779af00b415b"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "bdce275cc41b056173aabc5ea62de407"
server_key_iv: "a9cdfd0c9c4ea5ce24a0a6974735720f"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.217336 8157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:42:54.218056 8184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.218238 8157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:42:54.218361 8157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "02d7729c43754c2bb108779af00b415b"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "bdce275cc41b056173aabc5ea62de407"
server_key_iv: "a9cdfd0c9c4ea5ce24a0a6974735720f"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.218441 8157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:54.222009 8157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:54.222280 8157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:54.222450 8157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:54.222664 8157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:54.222982 8157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:54.223018 8157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.223067 8157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:54.223094 8157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.229081 8157 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:33887
I20260812 16:42:54.229143 8385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:33887 every 8 connection(s)
I20260812 16:42:54.229566 8157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:54.232574 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.230362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:38029 (local address 127.21.114.126:37987)
0812 16:42:54.230435 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:54.230437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:54.230659 (+ 222us) server_negotiation.cc:407] Connection header received
0812 16:42:54.231125 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:54.231126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:54.231133 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:54.231195 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:54.232352 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:54.232354 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:54.232354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:54.232359 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:54.232378 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:54.232384 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:54.232438 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:54.232505 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 16:42:54.232520 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 16:42:54.232736 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 8157
I20260812 16:42:54.232841 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:54.232842 8389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.230343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37987 (local address 127.21.114.65:38029)
0812 16:42:54.230526 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:54.230566 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:54.231040 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:54.231247 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:54.231251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:54.231260 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:54.232162 (+ 902us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:54.232162 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:54.232190 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:54.232218 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:54.232437 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:54.232440 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:54.232443 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:54.232499 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 16:42:54.232580 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260812 16:42:54.233063 21961 external_mini_cluster.cc:1428] Setting key 97e40d76ee312f4b598096748c07ce2d
I20260812 16:42:54.233367 8387 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37987
I20260812 16:42:54.233462 8387 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:54.233600 8387 heartbeater.cc:511] Master 127.21.114.126:37987 requested a full tablet report, sending...
I20260812 16:42:54.234033 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--builtin_ntp_servers=127.21.114.84:37179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 16:42:54.234163 8045 ts_manager.cc:194] Registered new tserver with Master: 02d7729c43754c2bb108779af00b415b (127.21.114.65:33887)
W20260812 16:42:54.321508 8391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:54.321718 8391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:54.321764 8391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:54.322954 8391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:54.322996 8391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:54.323021 8391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:54.324357 8391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:54.324569 8391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:54.324833 8391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:54.330317 8401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:54.330335 8391 server_base.cc:1034] running on GCE node
W20260812 16:42:54.330456 8400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:54.330332 8403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:54.330797 8391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:54.331056 8391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:54.332249 8391 hybrid_clock.cc:648] HybridClock initialized: now 1786552974332230 us; error 44 us; skew 500 ppm
I20260812 16:42:54.333773 8391 webserver.cc:460] Webserver started at http://127.21.114.66:45475/ using document root <none> and password file <none>
I20260812 16:42:54.334048 8391 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:54.334120 8391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:54.334275 8391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:54.335372 8391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "533fa357cf014945ac2e786b90291493"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "616bb6b4b912942034dc86824ad2ef60"
server_key_iv: "a14e75358e6c51d35efd00f533641fa1"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.335757 8391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "533fa357cf014945ac2e786b90291493"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "616bb6b4b912942034dc86824ad2ef60"
server_key_iv: "a14e75358e6c51d35efd00f533641fa1"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.337266 8391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 16:42:54.338122 8413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.338331 8391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:54.338444 8391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "533fa357cf014945ac2e786b90291493"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "616bb6b4b912942034dc86824ad2ef60"
server_key_iv: "a14e75358e6c51d35efd00f533641fa1"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.338523 8391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:54.342080 8391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:54.342352 8391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:54.342495 8391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:54.342700 8391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:54.343005 8391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:54.343060 8391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.343099 8391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:54.343127 8391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.349073 8391 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:40913
I20260812 16:42:54.349144 8624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:40913 every 8 connection(s)
I20260812 16:42:54.349526 8391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:54.353031 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.350471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:47175 (local address 127.21.114.126:37987)
0812 16:42:54.350648 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:54.350650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:54.350848 (+ 198us) server_negotiation.cc:407] Connection header received
0812 16:42:54.351372 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:54.351373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:54.351381 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:54.351432 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:54.352745 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:54.352747 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:54.352747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:54.352751 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:54.352769 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:54.352774 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:54.352850 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:54.352945 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 16:42:54.352961 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260812 16:42:54.353245 8632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.350344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37987 (local address 127.21.114.66:47175)
0812 16:42:54.350697 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:54.350730 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:54.351253 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:54.351508 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:54.351511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:54.351519 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:54.352577 (+ 1058us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:54.352578 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:54.352607 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:54.352636 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:54.352850 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:54.352857 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:54.352860 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:54.352961 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 16:42:54.353030 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":107,"threads_started":1}
I20260812 16:42:54.353762 8627 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37987
I20260812 16:42:54.353849 8627 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:54.354040 8627 heartbeater.cc:511] Master 127.21.114.126:37987 requested a full tablet report, sending...
I20260812 16:42:54.354422 8045 ts_manager.cc:194] Registered new tserver with Master: 533fa357cf014945ac2e786b90291493 (127.21.114.66:40913)
I20260812 16:42:54.359408 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 8391
I20260812 16:42:54.359534 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:54.359737 21961 external_mini_cluster.cc:1428] Setting key 4b419c9e9338be0a1ef6aca860f8c54a
I20260812 16:42:54.360749 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--builtin_ntp_servers=127.21.114.84:37179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 16:42:54.446189 8633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:54.446410 8633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:54.446434 8633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:54.447635 8633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:54.447681 8633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:54.447707 8633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:54.449165 8633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:54.449433 8633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:54.449755 8633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:54.455039 8640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:54.455163 8633 server_base.cc:1034] running on GCE node
W20260812 16:42:54.455032 8645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:54.455031 8641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:54.455523 8633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:54.455847 8633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:54.457011 8633 hybrid_clock.cc:648] HybridClock initialized: now 1786552974456977 us; error 51 us; skew 500 ppm
I20260812 16:42:54.458441 8633 webserver.cc:460] Webserver started at http://127.21.114.67:46247/ using document root <none> and password file <none>
I20260812 16:42:54.458716 8633 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:54.458819 8633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:54.458974 8633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:54.460105 8633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "5d4e9a09ba4649b699cf2093881f480d"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "93d7b271f12b405d36754d6ce9177308"
server_key_iv: "3bc1db938600e36710170d556970c25d"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.460529 8633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "5d4e9a09ba4649b699cf2093881f480d"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "93d7b271f12b405d36754d6ce9177308"
server_key_iv: "3bc1db938600e36710170d556970c25d"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.462143 8633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:54.463027 8666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.463268 8633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:42:54.463388 8633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "5d4e9a09ba4649b699cf2093881f480d"
format_stamp: "Formatted at 2026-08-12 16:42:54 on dist-test-slave-45dx"
server_key: "93d7b271f12b405d36754d6ce9177308"
server_key_iv: "3bc1db938600e36710170d556970c25d"
server_key_version: "encryptionkey@0"
I20260812 16:42:54.463469 8633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:54.467355 8633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:54.467639 8633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:54.467788 8633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:54.468042 8633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:54.468429 8633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:54.468487 8633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.468529 8633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:54.468555 8633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:54.474550 8633 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:34777
I20260812 16:42:54.474601 8871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:34777 every 8 connection(s)
I20260812 16:42:54.474938 8633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:54.476547 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 8633
I20260812 16:42:54.476656 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:54.476876 21961 external_mini_cluster.cc:1428] Setting key b9fd985bdb016a771c5f6746c33d5922
I20260812 16:42:54.478572 8112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.475662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:48633 (local address 127.21.114.126:37987)
0812 16:42:54.475713 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:54.475731 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:54.475981 (+ 250us) server_negotiation.cc:407] Connection header received
0812 16:42:54.476678 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:54.476680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:54.476688 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:54.476813 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:54.478292 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:54.478294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:54.478294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:42:54.478299 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:54.478316 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:42:54.478321 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:54.478401 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:54.478483 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 16:42:54.478499 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:42:54.478786 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:54.475630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37987 (local address 127.21.114.67:48633)
0812 16:42:54.475826 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:54.475866 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:54.476472 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:54.476855 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:54.476859 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:54.476867 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:54.478120 (+ 1253us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:42:54.478121 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:54.478159 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:42:54.478189 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:54.478399 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:54.478406 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:54.478410 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:54.478494 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 16:42:54.478559 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":74,"threads_started":1}
I20260812 16:42:54.479290 8878 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37987
I20260812 16:42:54.479388 8878 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:54.479498 8878 heartbeater.cc:511] Master 127.21.114.126:37987 requested a full tablet report, sending...
I20260812 16:42:54.479846 8045 ts_manager.cc:194] Registered new tserver with Master: 5d4e9a09ba4649b699cf2093881f480d (127.21.114.67:34777)
I20260812 16:42:54.488924 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 16:42:54.490878 8112 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:42:54.490344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47740 (local address 127.21.114.126:37987)
0812 16:42:54.490448 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:54.490451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:54.490519 (+ 68us) server_negotiation.cc:407] Connection header received
0812 16:42:54.490593 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:54.490594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:54.490600 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:54.490674 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:54.490815 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47740: BlockingRecv error: recv got EOF from 127.0.0.1:47740 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 16:42:54.491005 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 8157
I20260812 16:42:54.509127 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 8391
I20260812 16:42:54.520483 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 8633
I20260812 16:42:54.531092 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 7988
2026-08-12T16:42:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (603 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:54 dist-test-slave-45dx krb5kdc[8893](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:54 dist-test-slave-45dx krb5kdc[8893](info): set up 2 sockets
Aug 12 16:42:54 dist-test-slave-45dx krb5kdc[8893](info): commencing operation
krb5kdc: starting...
W20260812 16:42:55.840808 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:55 dist-test-slave-45dx krb5kdc[8893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:42:55.966661 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42581
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:56.049710 8916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:56.049968 8916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:56.050009 8916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:56.051143 8916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:42:56.051210 8916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:56.051234 8916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:56.051292 8916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:42:56.051321 8916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:42:56.052906 8916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:56.053180 8916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:56.053412 8916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:56.058612 8916 server_base.cc:1034] running on GCE node
W20260812 16:42:56.058570 8922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.058593 8923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.058561 8927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:56.059041 8916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:56.059402 8916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:56.060577 8916 hybrid_clock.cc:648] HybridClock initialized: now 1786552976060572 us; error 38 us; skew 500 ppm
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:56.063293 8916 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:42:56.063722 8916 webserver.cc:460] Webserver started at http://127.21.114.126:46397/ using document root <none> and password file <none>
I20260812 16:42:56.063980 8916 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:56.064051 8916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:56.064208 8916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:56.065294 8916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "05a9ccf3d5eb48069eec9db2a8821a4f"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "8f28f772bed921519c5e50a78e33ad73"
server_key_iv: "b9624e4d43e877fdd2bc098dc117d434"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.065668 8916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "05a9ccf3d5eb48069eec9db2a8821a4f"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "8f28f772bed921519c5e50a78e33ad73"
server_key_iv: "b9624e4d43e877fdd2bc098dc117d434"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.067020 8916 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:42:56.067868 8937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.068084 8916 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:56.068192 8916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "05a9ccf3d5eb48069eec9db2a8821a4f"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "8f28f772bed921519c5e50a78e33ad73"
server_key_iv: "b9624e4d43e877fdd2bc098dc117d434"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.068279 8916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:56.077031 8916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:56.079342 8916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:56.079510 8916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:56.083761 8916 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:42581
I20260812 16:42:56.083793 9036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:42581 every 8 connection(s)
I20260812 16:42:56.084159 8916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:42:56.085259 9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:56.087572 9038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f: Bootstrap starting.
I20260812 16:42:56.088187 9038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:56.088531 9038 log.cc:824] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:56.089264 9038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f: No bootstrap required, opened a new log
I20260812 16:42:56.090993 9038 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42581 } }
I20260812 16:42:56.091136 9038 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:56.091158 9038 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a9ccf3d5eb48069eec9db2a8821a4f, State: Initialized, Role: FOLLOWER
I20260812 16:42:56.091341 9038 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42581 } }
I20260812 16:42:56.091409 9038 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:42:56.091431 9038 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:42:56.091485 9038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:56.092128 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 8916
I20260812 16:42:56.092253 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:42:56.092430 9038 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42581 } }
I20260812 16:42:56.092517 21961 external_mini_cluster.cc:1428] Setting key a502dd5894f30b7bb6747a8da4198759
I20260812 16:42:56.092549 9038 leader_election.cc:302] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05a9ccf3d5eb48069eec9db2a8821a4f; no voters:
I20260812 16:42:56.092727 9038 leader_election.cc:288] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:42:56.092751 9043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:56.092940 9043 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [term 1 LEADER]: Becoming Leader. State: Replica: 05a9ccf3d5eb48069eec9db2a8821a4f, State: Running, Role: LEADER
I20260812 16:42:56.093034 9038 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:42:56.093087 9043 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42581 } }
I20260812 16:42:56.093497 9050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42581 } } }
I20260812 16:42:56.093508 9051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05a9ccf3d5eb48069eec9db2a8821a4f. Latest consensus state: current_term: 1 leader_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a9ccf3d5eb48069eec9db2a8821a4f" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42581 } } }
I20260812 16:42:56.093611 9050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:56.093617 9051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f [sys.catalog]: This master's current role is: LEADER
I20260812 16:42:56.093868 9070 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:42:56.094532 9070 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:42:56.096297 9070 catalog_manager.cc:1347] Generated new cluster ID: 27160da1b34749bbadc05cd209690e0e
I20260812 16:42:56.096374 9070 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:56.105326 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.093072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.21.114.126:42581)
0812 16:42:56.093523 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.093533 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.093572 (+ 39us) server_negotiation.cc:407] Connection header received
0812 16:42:56.093698 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.093706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.093790 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.094806 (+ 1016us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:56.095024 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.096266 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.097308 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.097913 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.098012 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.100949 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:56.100954 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:56.100954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:56.100967 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:56.103572 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.103983 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.103987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.103987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.104131 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.104383 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.104383 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.104384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.104687 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:56.104840 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.104974 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.105108 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":85,"threads_started":1}
I20260812 16:42:56.109077 9070 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:42:56.109602 9070 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:42:56.121143 9070 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f: Generated new TSK 0
I20260812 16:42:56.121343 9070 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:42:56.151782 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42581
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:56.236919 9097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:56.237118 9097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:56.237142 9097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:56.238288 9097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:56.238332 9097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:56.238389 9097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:42:56.239850 9097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:56.240061 9097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:56.240303 9097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:42:56.245457 9097 server_base.cc:1034] running on GCE node
W20260812 16:42:56.245424 9112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.245461 9113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.245440 9117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:56.245805 9097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:56.246021 9097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:56.247370 9097 hybrid_clock.cc:648] HybridClock initialized: now 1786552976247362 us; error 47 us; skew 500 ppm
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:56.250188 9097 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:42:56.250627 9097 webserver.cc:460] Webserver started at http://127.21.114.65:42855/ using document root <none> and password file <none>
I20260812 16:42:56.250908 9097 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:56.250983 9097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:56.251133 9097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:56.252179 9097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "4460af48c63f4b84859e93e3f93937df"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "a2fee82c8d9c7ba5c3f0df1d39c533fb"
server_key_iv: "42d38d8d5bafd424579d4c0b7364405a"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.252704 9097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "4460af48c63f4b84859e93e3f93937df"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "a2fee82c8d9c7ba5c3f0df1d39c533fb"
server_key_iv: "42d38d8d5bafd424579d4c0b7364405a"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.254091 9097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:56.254916 9126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.255110 9097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:56.255215 9097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "4460af48c63f4b84859e93e3f93937df"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "a2fee82c8d9c7ba5c3f0df1d39c533fb"
server_key_iv: "42d38d8d5bafd424579d4c0b7364405a"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.255316 9097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:56.264027 9097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:56.266865 9097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:56.267027 9097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:56.267388 9097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:56.267767 9097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:56.267822 9097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.267856 9097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:56.267884 9097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.273772 9097 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:46591
I20260812 16:42:56.273885 9339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:46591 every 8 connection(s)
I20260812 16:42:56.274169 9097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:42:56.277537 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 9097
I20260812 16:42:56.277654 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:42:56.277869 21961 external_mini_cluster.cc:1428] Setting key 88d4c206a7b6518fe9daf53713ef19d1
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:56.284292 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.274909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:57283 (local address 127.21.114.126:42581)
0812 16:42:56.274970 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.274972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.275180 (+ 208us) server_negotiation.cc:407] Connection header received
0812 16:42:56.275653 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.275654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.275666 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.275724 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:56.276754 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.277276 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.278714 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.278911 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.278966 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.281331 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:56.281332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:56.281333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:56.281341 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:56.282816 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.283327 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.283328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.283329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.283380 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.283666 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.283666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.283667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.283764 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:56.283814 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.284163 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.284229 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 16:42:56.284644 9347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.274885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42581 (local address 127.21.114.65:57283)
0812 16:42:56.275052 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.275095 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.275573 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.275805 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.275808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.276473 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:56.276676 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.276681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.277380 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.277381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.278634 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.278637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.278999 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.279000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.279159 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.279646 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:56.279657 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:56.281244 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:56.282910 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:56.282917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:56.282919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:56.283247 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:56.283449 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:56.283450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:56.283450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:56.283593 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:56.283840 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:56.283847 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:56.284016 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.284144 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.284351 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260812 16:42:56.285156 9343 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42581
I20260812 16:42:56.285270 9343 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:56.285468 9343 heartbeater.cc:511] Master 127.21.114.126:42581 requested a full tablet report, sending...
I20260812 16:42:56.286048 8967 ts_manager.cc:194] Registered new tserver with Master: 4460af48c63f4b84859e93e3f93937df (127.21.114.65:46591)
I20260812 16:42:56.286653 8967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:57283
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:42:56.307189 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42581
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:56.389566 9354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:56.389803 9354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:56.389844 9354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:56.390991 9354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:56.391059 9354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:56.391104 9354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:42:56.392709 9354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:56.392970 9354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:56.393250 9354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:56.398382 9362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.398414 9360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.398413 9367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:56.398566 9354 server_base.cc:1034] running on GCE node
I20260812 16:42:56.398861 9354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:56.399111 9354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:56.400291 9354 hybrid_clock.cc:648] HybridClock initialized: now 1786552976400279 us; error 31 us; skew 500 ppm
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:56.403057 9354 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:42:56.403515 9354 webserver.cc:460] Webserver started at http://127.21.114.66:37043/ using document root <none> and password file <none>
I20260812 16:42:56.403715 9354 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:56.403755 9354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:56.403851 9354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:56.404912 9354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "ab2c978766c34c5087db6832e1bd5869"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "1725fcd871f3175c07101604c4fe4174"
server_key_iv: "d00373763362f7d7d3cdaece4b69eb8d"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.405200 9354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "ab2c978766c34c5087db6832e1bd5869"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "1725fcd871f3175c07101604c4fe4174"
server_key_iv: "d00373763362f7d7d3cdaece4b69eb8d"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.406450 9354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 16:42:56.407172 9380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.407397 9354 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:56.407495 9354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "ab2c978766c34c5087db6832e1bd5869"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "1725fcd871f3175c07101604c4fe4174"
server_key_iv: "d00373763362f7d7d3cdaece4b69eb8d"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.407554 9354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:56.436663 9354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:56.439169 9354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:56.439296 9354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:56.439491 9354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:56.439829 9354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:56.439867 9354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.439890 9354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:56.439937 9354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.446111 9354 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:34497
I20260812 16:42:56.446164 9598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:34497 every 8 connection(s)
I20260812 16:42:56.446488 9354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:42:56.452814 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 9354
I20260812 16:42:56.452939 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:42:56.453152 21961 external_mini_cluster.cc:1428] Setting key 3d0fd6f25bd93d762d3a3c2eeed46b5e
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:56.456981 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.447235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51409 (local address 127.21.114.126:42581)
0812 16:42:56.447295 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.447312 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.447510 (+ 198us) server_negotiation.cc:407] Connection header received
0812 16:42:56.448061 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.448062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.448078 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.448133 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:56.449196 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.449719 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.450763 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.451139 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.451231 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.453849 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:56.453851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:56.453851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:56.453858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:56.455363 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.455918 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.455920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.455920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.455980 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.456268 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.456268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.456269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.456427 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:56.456483 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.456830 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.456918 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:42:56.457276 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.447211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42581 (local address 127.21.114.66:51409)
0812 16:42:56.447379 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.447425 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.447951 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.448205 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.448209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.448882 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:56.449087 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.449093 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.449828 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.449829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.450654 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.450656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.451262 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.451264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.451418 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.451918 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:56.451928 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:56.453722 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:56.455467 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:56.455475 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:56.455477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:56.455818 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:56.456054 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:56.456055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:56.456056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:56.456201 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:56.456494 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:56.456500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:56.456669 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.456812 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.456997 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":74,"threads_started":1}
I20260812 16:42:56.457834 9601 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42581
I20260812 16:42:56.457937 9601 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:56.458153 9601 heartbeater.cc:511] Master 127.21.114.126:42581 requested a full tablet report, sending...
I20260812 16:42:56.458570 8967 ts_manager.cc:194] Registered new tserver with Master: ab2c978766c34c5087db6832e1bd5869 (127.21.114.66:34497)
I20260812 16:42:56.458962 8967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:51409
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:42:56.481539 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42581
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:42:56.566354 9612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:42:56.566560 9612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:42:56.566583 9612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:42:56.567656 9612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:42:56.567710 9612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:42:56.567744 9612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:42:56.569308 9612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:42:56.569564 9612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:42:56.569818 9612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:42:56.575320 9620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.575282 9622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:42:56.575532 9624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:42:56.575497 9612 server_base.cc:1034] running on GCE node
I20260812 16:42:56.575788 9612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:42:56.575997 9612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:42:56.577137 9612 hybrid_clock.cc:648] HybridClock initialized: now 1786552976577116 us; error 36 us; skew 500 ppm
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:42:56.579744 9612 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:42:56.580253 9612 webserver.cc:460] Webserver started at http://127.21.114.67:40421/ using document root <none> and password file <none>
I20260812 16:42:56.580535 9612 fs_manager.cc:359] Metadata directory not provided
I20260812 16:42:56.580608 9612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:42:56.580765 9612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:42:56.581813 9612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "61ee825caa7a477dbf9aa1cb75fb75d4"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "0f20f8ec788d0d9d5fb59b77c3fb3257"
server_key_iv: "7329ce9655b78caefe5bc9895dd46046"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.582191 9612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "61ee825caa7a477dbf9aa1cb75fb75d4"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "0f20f8ec788d0d9d5fb59b77c3fb3257"
server_key_iv: "7329ce9655b78caefe5bc9895dd46046"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.583528 9612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:42:56.584287 9637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.584527 9612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:42:56.584630 9612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "61ee825caa7a477dbf9aa1cb75fb75d4"
format_stamp: "Formatted at 2026-08-12 16:42:56 on dist-test-slave-45dx"
server_key: "0f20f8ec788d0d9d5fb59b77c3fb3257"
server_key_iv: "7329ce9655b78caefe5bc9895dd46046"
server_key_version: "encryptionkey@0"
I20260812 16:42:56.584718 9612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:42:56.615300 9612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:42:56.617455 9612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:42:56.617627 9612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:42:56.617883 9612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:42:56.618209 9612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:42:56.618266 9612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.618314 9612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:42:56.618335 9612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:42:56.624543 9612 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:38505
I20260812 16:42:56.624589 9848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:38505 every 8 connection(s)
I20260812 16:42:56.624922 9612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:42:56.626925 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 9612
I20260812 16:42:56.627044 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:42:56.627254 21961 external_mini_cluster.cc:1428] Setting key 250ad2c652a727b7759fb15de9d1187d
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[8893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552976, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:42:56.634944 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.625629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:37429 (local address 127.21.114.126:42581)
0812 16:42:56.625694 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.625697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.625923 (+ 226us) server_negotiation.cc:407] Connection header received
0812 16:42:56.626485 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.626486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.626500 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.626551 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:56.627834 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.628417 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.629463 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.629679 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.629758 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.631998 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:56.632000 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:56.632000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:56.632008 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:56.633528 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.633935 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.633937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.633937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.634003 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.634271 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.634273 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.634273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.634398 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:56.634478 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.634763 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.634849 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:42:56.635125 9852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.625643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42581 (local address 127.21.114.67:37429)
0812 16:42:56.625796 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.625838 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.626370 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.626622 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.626625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.627463 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:42:56.627727 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.627733 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.628496 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.628497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.629367 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.629370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.629766 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.629767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.629910 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.630386 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:42:56.630395 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:42:56.631899 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:42:56.633613 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:56.633619 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:56.633622 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:56.633855 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:56.634081 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:42:56.634082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:42:56.634082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:42:56.634200 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:42:56.634470 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:42:56.634476 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:42:56.634619 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.634725 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.634890 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260812 16:42:56.635615 9850 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42581
I20260812 16:42:56.635699 9850 heartbeater.cc:464] Registering TS with master...
I20260812 16:42:56.635839 9850 heartbeater.cc:511] Master 127.21.114.126:42581 requested a full tablet report, sending...
I20260812 16:42:56.636175 8967 ts_manager.cc:194] Registered new tserver with Master: 61ee825caa7a477dbf9aa1cb75fb75d4 (127.21.114.67:38505)
I20260812 16:42:56.636593 8967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:37429
I20260812 16:42:56.639601 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:42:56.646441 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.640943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48276 (local address 127.21.114.126:42581)
0812 16:42:56.641009 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.641011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.641115 (+ 104us) server_negotiation.cc:407] Connection header received
0812 16:42:56.641162 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.641162 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.641171 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.641210 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:42:56.641774 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.642215 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.642891 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.643069 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.643122 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.644182 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:42:56.644183 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:42:56.644184 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:42:56.644190 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:42:56.645459 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.645788 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.645789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.645789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.645843 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:42:56.646011 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:42:56.646011 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:42:56.646012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:42:56.646160 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:42:56.646231 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.646325 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.646382 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:56.648185 8967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:42:56.649901 8967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:42:56.656335 9868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.652295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:34497 (local address 127.0.0.1:42530)
0812 16:42:56.652488 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.652516 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.652598 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.653065 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.653068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.653070 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:56.653138 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.653139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.654065 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.654066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.655068 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.655071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.655991 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.655991 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.656067 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.656080 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.656182 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.656239 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":56,"threads_started":1}
I20260812 16:42:56.656364 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.652523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42530 (local address 127.21.114.66:34497)
0812 16:42:56.652767 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.652772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.652785 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:42:56.652828 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.652830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.652846 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.652962 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:56.653205 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.653959 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.655174 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.655895 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.655989 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.656057 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.656201 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.656242 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":85,"threads_started":1}
I20260812 16:42:56.657037 9872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.652600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38505 (local address 127.0.0.1:44270)
0812 16:42:56.652911 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.652921 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.653006 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.653309 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.653310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.653312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:56.653359 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.653360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.654636 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.654637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.655856 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.655859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.656780 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.656781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.656850 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.656853 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.656928 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.656968 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":73,"threads_started":1}
I20260812 16:42:56.657063 9873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.652446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44270 (local address 127.21.114.67:38505)
0812 16:42:56.652646 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.652651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.652975 (+ 324us) server_negotiation.cc:407] Connection header received
0812 16:42:56.653141 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.653143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.653158 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.653228 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:56.653443 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.654522 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.655947 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.656697 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.656752 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.656838 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.656946 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.656988 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260812 16:42:56.657123 9878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.652296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:46591 (local address 127.0.0.1:57466)
0812 16:42:56.652708 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.652718 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.652760 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.653359 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.653360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.653362 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:56.653437 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.653439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.654658 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.654659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.655591 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.655594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.656878 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.656879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.656952 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.656956 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.657008 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.657048 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":32,"thread_start_us":76,"threads_started":1}
I20260812 16:42:56.657363 9879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.652723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57466 (local address 127.21.114.65:46591)
0812 16:42:56.652944 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.652948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.652959 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:42:56.652999 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.653002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.653188 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.653264 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:56.653521 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.654558 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.655695 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.656356 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.656556 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.656611 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.657238 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.657290 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260812 16:42:56.657255 9466 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3ef109078a415289b832e13eee558e (DEFAULT_TABLE table=test-table [id=ed766bce8b344468bce1d11c9cd44f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:56.657699 9466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3ef109078a415289b832e13eee558e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:56.657792 9720 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3ef109078a415289b832e13eee558e (DEFAULT_TABLE table=test-table [id=ed766bce8b344468bce1d11c9cd44f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:56.658111 9720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3ef109078a415289b832e13eee558e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:56.658033 9209 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3ef109078a415289b832e13eee558e (DEFAULT_TABLE table=test-table [id=ed766bce8b344468bce1d11c9cd44f6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:42:56.658350 9209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3ef109078a415289b832e13eee558e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:42:56.660626 9880 tablet_bootstrap.cc:492] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Bootstrap starting.
I20260812 16:42:56.661206 9881 tablet_bootstrap.cc:492] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Bootstrap starting.
I20260812 16:42:56.661310 9880 tablet_bootstrap.cc:654] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:56.661927 9881 tablet_bootstrap.cc:654] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:56.661968 9880 log.cc:824] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:56.662297 9882 tablet_bootstrap.cc:492] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: Bootstrap starting.
I20260812 16:42:56.662580 9881 log.cc:824] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:56.662909 9880 tablet_bootstrap.cc:492] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: No bootstrap required, opened a new log
I20260812 16:42:56.662994 9880 ts_tablet_manager.cc:1397] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:56.662994 9882 tablet_bootstrap.cc:654] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: Neither blocks nor log segments found. Creating new log.
I20260812 16:42:56.663404 9881 tablet_bootstrap.cc:492] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: No bootstrap required, opened a new log
I20260812 16:42:56.663473 9882 log.cc:824] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: Log is configured to *not* fsync() on all Append() calls
I20260812 16:42:56.663532 9881 ts_tablet_manager.cc:1397] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:56.664165 9882 tablet_bootstrap.cc:492] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: No bootstrap required, opened a new log
I20260812 16:42:56.664247 9882 ts_tablet_manager.cc:1397] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:42:56.665056 9880 raft_consensus.cc:348] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.665234 9880 raft_consensus.cc:374] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:56.665269 9880 raft_consensus.cc:729] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ee825caa7a477dbf9aa1cb75fb75d4, State: Initialized, Role: FOLLOWER
I20260812 16:42:56.665422 9880 consensus_queue.cc:260] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.665490 9881 raft_consensus.cc:348] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.665643 9881 raft_consensus.cc:374] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:56.665690 9881 raft_consensus.cc:729] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab2c978766c34c5087db6832e1bd5869, State: Initialized, Role: FOLLOWER
I20260812 16:42:56.665714 9880 ts_tablet_manager.cc:1428] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:42:56.665822 9850 heartbeater.cc:503] Master 127.21.114.126:42581 was elected leader, sending a full tablet report...
I20260812 16:42:56.665808 9881 consensus_queue.cc:260] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.666102 9881 ts_tablet_manager.cc:1428] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:42:56.666112 9601 heartbeater.cc:503] Master 127.21.114.126:42581 was elected leader, sending a full tablet report...
I20260812 16:42:56.666128 9882 raft_consensus.cc:348] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.666289 9882 raft_consensus.cc:374] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:42:56.666325 9882 raft_consensus.cc:729] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4460af48c63f4b84859e93e3f93937df, State: Initialized, Role: FOLLOWER
I20260812 16:42:56.666471 9882 consensus_queue.cc:260] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.666752 9882 ts_tablet_manager.cc:1428] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 16:42:56.666877 9343 heartbeater.cc:503] Master 127.21.114.126:42581 was elected leader, sending a full tablet report...
I20260812 16:42:56.669046 9893 raft_consensus.cc:482] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:42:56.669126 9893 raft_consensus.cc:504] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.669510 9893 leader_election.cc:288] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4460af48c63f4b84859e93e3f93937df (127.21.114.65:46591), 61ee825caa7a477dbf9aa1cb75fb75d4 (127.21.114.67:38505)
I20260812 16:42:56.672394 9879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.669668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:48975 (local address 127.21.114.65:46591)
0812 16:42:56.669730 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.669732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.669740 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:42:56.669787 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.669788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.669798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.669847 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:56.670015 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.670523 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.671606 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.671998 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.672108 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.672118 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.672289 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.672341 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:42:56.672394 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.669627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:46591 (local address 127.21.114.66:48975)
0812 16:42:56.669673 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.669683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.669725 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.669893 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.669895 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.669896 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:56.669954 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.669956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.670587 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.670587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.671497 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.671499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.672108 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.672109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.672198 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.672201 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.672269 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.672308 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":3}
I20260812 16:42:56.672742 9249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3ef109078a415289b832e13eee558e" candidate_uuid: "ab2c978766c34c5087db6832e1bd5869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4460af48c63f4b84859e93e3f93937df" is_pre_election: true
I20260812 16:42:56.672946 9249 raft_consensus.cc:2454] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab2c978766c34c5087db6832e1bd5869 in term 0.
I20260812 16:42:56.673151 9390 leader_election.cc:302] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4460af48c63f4b84859e93e3f93937df, ab2c978766c34c5087db6832e1bd5869; no voters:
I20260812 16:42:56.673213 9873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.669870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:55769 (local address 127.21.114.67:38505)
0812 16:42:56.669929 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.669931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.669938 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:42:56.669957 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.669958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.669965 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.670016 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:42:56.670735 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.671237 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.672255 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.672853 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.672947 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.672955 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.673141 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.673172 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:42:56.673251 9895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.669668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38505 (local address 127.21.114.66:55769)
0812 16:42:56.669815 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.669833 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 16:42:56.669880 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:42:56.670604 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:42:56.670605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:42:56.670607 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:42:56.670661 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.670662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.671316 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.671317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.672176 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:42:56.672179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.672992 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.672993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:42:56.673070 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.673075 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:42:56.673133 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 16:42:56.673176 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260812 16:42:56.673290 9893 raft_consensus.cc:2781] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:42:56.673336 9893 raft_consensus.cc:482] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:42:56.673367 9893 raft_consensus.cc:3037] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:56.673521 9763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3ef109078a415289b832e13eee558e" candidate_uuid: "ab2c978766c34c5087db6832e1bd5869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" is_pre_election: true
I20260812 16:42:56.673659 9763 raft_consensus.cc:2454] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab2c978766c34c5087db6832e1bd5869 in term 0.
I20260812 16:42:56.674124 9893 raft_consensus.cc:504] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.674381 9893 leader_election.cc:288] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [CANDIDATE]: Term 1 election: Requested vote from peers 4460af48c63f4b84859e93e3f93937df (127.21.114.65:46591), 61ee825caa7a477dbf9aa1cb75fb75d4 (127.21.114.67:38505)
I20260812 16:42:56.674392 9249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3ef109078a415289b832e13eee558e" candidate_uuid: "ab2c978766c34c5087db6832e1bd5869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4460af48c63f4b84859e93e3f93937df"
I20260812 16:42:56.674413 9763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3ef109078a415289b832e13eee558e" candidate_uuid: "ab2c978766c34c5087db6832e1bd5869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4"
I20260812 16:42:56.674454 9249 raft_consensus.cc:3037] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:56.674515 9763 raft_consensus.cc:3037] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:42:56.675110 9249 raft_consensus.cc:2454] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab2c978766c34c5087db6832e1bd5869 in term 1.
I20260812 16:42:56.675287 9390 leader_election.cc:302] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4460af48c63f4b84859e93e3f93937df, ab2c978766c34c5087db6832e1bd5869; no voters:
I20260812 16:42:56.675320 9763 raft_consensus.cc:2454] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab2c978766c34c5087db6832e1bd5869 in term 1.
I20260812 16:42:56.675395 9893 raft_consensus.cc:2781] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:42:56.675549 9893 raft_consensus.cc:686] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 1 LEADER]: Becoming Leader. State: Replica: ab2c978766c34c5087db6832e1bd5869, State: Running, Role: LEADER
I20260812 16:42:56.675638 9893 consensus_queue.cc:237] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } }
I20260812 16:42:56.676455 8967 catalog_manager.cc:5495] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab2c978766c34c5087db6832e1bd5869 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "ab2c978766c34c5087db6832e1bd5869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab2c978766c34c5087db6832e1bd5869" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 34497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260812 16:42:56.682184 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.679546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42534 (local address 127.21.114.66:34497)
0812 16:42:56.679585 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 16:42:56.679587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:42:56.679596 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:42:56.679688 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:42:56.679688 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:42:56.679704 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:42:56.679763 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:42:56.679923 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.680404 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.681424 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:42:56.681600 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:42:56.681654 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:42:56.681856 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:42:56.681944 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:42:56.682011 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 16:42:56.682073 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 16:42:56.682089 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:42:56.683740 9249 raft_consensus.cc:1261] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 1 FOLLOWER]: Refusing update from remote peer ab2c978766c34c5087db6832e1bd5869: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:56.683812 9763 raft_consensus.cc:1261] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 1 FOLLOWER]: Refusing update from remote peer ab2c978766c34c5087db6832e1bd5869: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:42:56.684093 9893 consensus_queue.cc:1035] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4460af48c63f4b84859e93e3f93937df" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:56.684218 9896 consensus_queue.cc:1035] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61ee825caa7a477dbf9aa1cb75fb75d4" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:42:56.686566 9900 mvcc.cc:205] Tried to move back new op lower bound from 7317720992494415872 to 7317720992464089088. Current Snapshot: MvccSnapshot[applied={T|T < 7317720992494415872}]
I20260812 16:42:56.686661 9908 mvcc.cc:205] Tried to move back new op lower bound from 7317720992494415872 to 7317720992464089088. Current Snapshot: MvccSnapshot[applied={T|T < 7317720992494415872}]
I20260812 16:42:56.687386 9907 mvcc.cc:205] Tried to move back new op lower bound from 7317720992494415872 to 7317720992464089088. Current Snapshot: MvccSnapshot[applied={T|T < 7317720992494415872}]
I20260812 16:42:56.689436 8967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:56.689532 8967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:42:56.690279 8967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05a9ccf3d5eb48069eec9db2a8821a4f: Sending DeleteTablet for 3 replicas of tablet 1f3ef109078a415289b832e13eee558e
I20260812 16:42:56.690618 9209 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3ef109078a415289b832e13eee558e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:56 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:57466
I20260812 16:42:56.690647 9720 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3ef109078a415289b832e13eee558e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:56 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:44270
I20260812 16:42:56.690733 9466 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3ef109078a415289b832e13eee558e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:42:56 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:42530
I20260812 16:42:56.690829 9924 tablet_replica.cc:330] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df: stopping tablet replica
I20260812 16:42:56.690922 9924 raft_consensus.cc:2229] T 1f3ef109078a415289b832e13eee558e P 4460af48c63f4b84859e93e3f93937df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:56.691038 9925 tablet_replica.cc:330] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: stopping tablet replica
I20260812 16:42:56.691078 9926 tablet_replica.cc:330] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: stopping tablet replica
I20260812 16:42:56.691165 9926 raft_consensus.cc:2229] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:42:56.691270 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 9097
I20260812 16:42:56.691285 9926 raft_consensus.cc:2258] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:56.691190 9925 raft_consensus.cc:2229] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:42:56.692196 9925 raft_consensus.cc:2258] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:42:56.698673 9925 ts_tablet_manager.cc:1905] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:56.700484 9925 ts_tablet_manager.cc:1918] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:56.700614 9925 log.cc:1196] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/1f3ef109078a415289b832e13eee558e
I20260812 16:42:56.700928 9925 ts_tablet_manager.cc:1939] T 1f3ef109078a415289b832e13eee558e P 61ee825caa7a477dbf9aa1cb75fb75d4: Deleting consensus metadata
I20260812 16:42:56.701387 8942 catalog_manager.cc:4841] TS 61ee825caa7a477dbf9aa1cb75fb75d4 (127.21.114.67:38505): tablet 1f3ef109078a415289b832e13eee558e (table test-table [id=ed766bce8b344468bce1d11c9cd44f6d]) successfully deleted
I20260812 16:42:56.705612 9926 ts_tablet_manager.cc:1905] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:42:56.707357 9926 ts_tablet_manager.cc:1918] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:42:56.707504 9926 log.cc:1196] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/1f3ef109078a415289b832e13eee558e
I20260812 16:42:56.707794 9926 ts_tablet_manager.cc:1939] T 1f3ef109078a415289b832e13eee558e P ab2c978766c34c5087db6832e1bd5869: Deleting consensus metadata
I20260812 16:42:56.709949 8943 catalog_manager.cc:4841] TS ab2c978766c34c5087db6832e1bd5869 (127.21.114.66:34497): tablet 1f3ef109078a415289b832e13eee558e (table test-table [id=ed766bce8b344468bce1d11c9cd44f6d]) successfully deleted
W20260812 16:42:56.736829 8944 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:46591 (error 108)
I20260812 16:42:56.737512 9878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:42:56.737356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:46591 (local address 127.0.0.1:57472)
0812 16:42:56.737423 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 16:42:56.737473 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:46591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 16:42:56.737569 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 9354
W20260812 16:42:56.745620 8944 catalog_manager.cc:4584] TS 4460af48c63f4b84859e93e3f93937df (127.21.114.65:46591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1f3ef109078a415289b832e13eee558e: Network error: Client connection negotiation failed: client connection to 127.21.114.65:46591: connect: Connection refused (error 111)
I20260812 16:42:56.751602 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 9612
I20260812 16:42:56.775633 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 8916
2026-08-12T16:42:56Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2250 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[9930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[9930](info): set up 2 sockets
Aug 12 16:42:56 dist-test-slave-45dx krb5kdc[9930](info): commencing operation
krb5kdc: starting...
W20260812 16:42:58.112067 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:42:58 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786552978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:42:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:42:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/rangeradmin_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/rangeradmin_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/rangerlookup_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/rangerlookup_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
I20260812 16:42:58.284941 21961 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskP_fNe3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/postgres -l logfile start
2026-08-12 16:43:00.768 UTC [9985] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 16:43:00.768 UTC [9985] LOG: listening on IPv4 address "127.21.114.84", port 59047
2026-08-12 16:43:00.772 UTC [9985] LOG: listening on Unix socket "/tmp/.s.PGSQL.59047"
2026-08-12 16:43:00.809 UTC [9991] LOG: database system was shut down at 2026-08-12 16:42:59 UTC
2026-08-12 16:43:00.814 UTC [9985] LOG: database system is ready to accept connections
I20260812 16:43:02.025040 21961 mini_postgres.cc:96] Postgres bound to 59047
2026-08-12 16:43:02.032 UTC [10002] FATAL: database "slave" does not exist
127.21.114.84:59047 - accepting connections
I20260812 16:43:02.033411 21961 mini_ranger.cc:161] Starting Ranger...
I20260812 16:43:02.049114 21961 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 16:43:02.512984 21961 mini_ranger.cc:87] Created ranger Postgres database
I20260812 16:43:02.513098 21961 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-admin
2026-08-12 16:43:02,816 [I] DB FLAVOR :POSTGRES
2026-08-12 16:43:02,817 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 16:43:02,817 [I] Checking connection..
2026-08-12 16:43:02,817 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 16:43:03,092 [I] Checking connection passed.
2026-08-12 16:43:03,092 [I] --------- Verifying version history table ---------
2026-08-12 16:43:03,093 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 16:43:03,363 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 16:43:03,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 16:43:03,596 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 16:43:03,597 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 16:43:03,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 16:43:03.843 UTC [10115] WARNING: there is no transaction in progress
2026-08-12 16:43:03,849 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 16:43:03,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 16:43:04,107 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 16:43:04,108 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 16:43:04,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 16:43:04,381 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 16:43:04,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-45dx.c.gcp-upstream.internal','N') ;"
2026-08-12 16:43:04,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 16:43:05,138 [I] Table x_portal_user does not exist in database ranger
2026-08-12 16:43:05,138 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 16:43:05,409 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 16:43:05,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 16:43:05,658 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 16:43:05,899 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 16:43:05,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 16:43:06.875 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:06.891 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:06.907 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:06.925 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:06.947 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:06.969 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.024 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.030 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.044 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.054 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.064 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.078 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.087 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.094 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.101 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07.108 UTC [10321] WARNING: there is no transaction in progress
2026-08-12 16:43:07,772 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 16:43:07,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 16:43:08,019 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 16:43:08,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 16:43:08,254 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 16:43:08,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 16:43:08,523 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 16:43:08,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 16:43:08,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 16:43:09,074 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-45dx.c.gcp-upstream.internal';"
2026-08-12 16:43:09,354 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 16:43:09,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 16:43:09,615 [I] DB_PATCHES have already been applied
I20260812 16:43:09.621116 21961 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-admin:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskP_fNe3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 16:43:09.621207 21961 mini_ranger.cc:193] Using host: 127.21.114.84
I20260812 16:43:09.625181 21961 mini_ranger.cc:227] Ranger admin URL: http://127.21.114.84:59493
Aug 12, 2026 4:43:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 4:43:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 4:43:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 4:43:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 4:43:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 4:43:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 4:43:10 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 16:43:11.101418 21961 mini_ranger.cc:160] Time spent starting Ranger: real 9.068s user 0.000s sys 0.011s
Aug 12, 2026 4:43:30 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 4:43:30 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 4:43:30 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 4:43:30 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 4:43:31 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 16:43:31.632761 21961 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/rangerkms_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/rangerkms_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.114.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.21.114.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 16:43:31 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553011, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 16:43:31.717839 21961 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 16:43:31.727800 21961 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 16:43:32.595387 21961 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 16:43:32.595494 21961 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms
I20260812 16:43:32.595512 21961 mini_ranger_kms.cc:227] Using postgres at 127.21.114.84:59047
2026-08-12 16:43:33,256 [I] DB FLAVOR :POSTGRES
2026-08-12 16:43:33,256 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 16:43:33,257 [I] Checking connection
2026-08-12 16:43:33,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 16:43:33,582 [I] connection success
2026-08-12 16:43:33,582 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 16:43:33,582 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 16:43:33,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 16:43:33,850 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 16:43:33,851 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 16:43:33,851 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 16:43:33,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:59047/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 16:43:34,138 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 16:43:34.623018 21961 mini_ranger_kms.cc:310] Created kms service
I20260812 16:43:34.802734 21961 mini_ranger_kms.cc:326] Created kudu user
I20260812 16:43:34.850903 21961 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 16:43:34 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553011, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:43:35.248584 21961 mini_ranger_kms.cc:384] Added ranger policy
I20260812 16:43:35.248699 21961 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms:/tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 16:43:35.248723 21961 mini_ranger_kms.cc:240] Using host: 127.21.114.84
I20260812 16:43:35.253517 21961 mini_ranger_kms.cc:276] Ranger KMS PID: 10630
I20260812 16:43:35.253671 21961 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.21.114.84:45741
Aug 12, 2026 4:43:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 4:43:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 4:43:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 4:43:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 4:43:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 4:43:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 16:43:37 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786553017, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.114.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:43:38.176162 21961 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.458s user 0.000s sys 0.282s
I20260812 16:43:38.176283 21961 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 16:43:38.176383 21961 mini_ranger_kms.cc:401] 127.21.114.84:45741/kms/v1/keys
Aug 12 16:43:38 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553017, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.114.84@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
Aug 12 16:43:38 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553017, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.114.84@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
Aug 12 16:43:41 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:43:41.247871 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42613
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42613
--ranger_config_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:45741/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:43:41.345036 10712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:43:41.345243 10712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:43:41.345265 10712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:43:41.346390 10712 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:43:41.346434 10712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:43:41.346448 10712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:43:41.346460 10712 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:43:41.346472 10712 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:43:41.348333 10712 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal
--ranger_kms_url=127.21.114.84:45741/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42613
--ranger_config_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:43:41.348591 10712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:43:41.348843 10712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:43:41.355191 10730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:43:41.355254 10719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:43:41.355384 10712 server_base.cc:1034] running on GCE node
W20260812 16:43:41.355254 10725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:43:41.355810 10712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:43:41.356164 10712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:43:41.357329 10712 hybrid_clock.cc:648] HybridClock initialized: now 1786553021357319 us; error 40 us; skew 500 ppm
Aug 12 16:43:41 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553021, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:43:41.360208 10712 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:43:41.360697 10712 webserver.cc:460] Webserver started at http://127.21.114.126:32855/ using document root <none> and password file <none>
I20260812 16:43:41.360929 10712 fs_manager.cc:359] Metadata directory not provided
I20260812 16:43:41.360968 10712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:43:41.361094 10712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:43:41 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553021, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:43:41.418047 10712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "b516efcba6b3485fba4384f40f3bdf17"
format_stamp: "Formatted at 2026-08-12 16:43:41 on dist-test-slave-45dx"
server_key: "320198f245996fff8171fd4958061431"
server_key_iv: "0b9b4be923f46f631293f8c6e0e9eaf3"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:41.418557 10712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "b516efcba6b3485fba4384f40f3bdf17"
format_stamp: "Formatted at 2026-08-12 16:43:41 on dist-test-slave-45dx"
server_key: "320198f245996fff8171fd4958061431"
server_key_iv: "0b9b4be923f46f631293f8c6e0e9eaf3"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:41.420598 10712 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 16:43:41.435060 10746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:41.435341 10712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:43:41.435463 10712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b516efcba6b3485fba4384f40f3bdf17"
format_stamp: "Formatted at 2026-08-12 16:43:41 on dist-test-slave-45dx"
server_key: "320198f245996fff8171fd4958061431"
server_key_iv: "0b9b4be923f46f631293f8c6e0e9eaf3"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:41.435568 10712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:43:41.451570 10712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:43:41.453758 10712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:43:41.453990 10712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:43:41.461026 10712 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:42613
I20260812 16:43:41.461148 10831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:42613 every 8 connection(s)
I20260812 16:43:41.461483 10712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:43:41.462414 10833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:43:41.464524 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 10712
I20260812 16:43:41.464645 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:43:41.464840 21961 external_mini_cluster.cc:1428] Setting key 182bb2d86fb345d5ab5bd763722c3e1b
I20260812 16:43:41.465704 10833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17: Bootstrap starting.
I20260812 16:43:41.466400 10833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17: Neither blocks nor log segments found. Creating new log.
I20260812 16:43:41.466717 10833 log.cc:824] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17: Log is configured to *not* fsync() on all Append() calls
I20260812 16:43:41.467700 10833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17: No bootstrap required, opened a new log
I20260812 16:43:41.470361 10833 raft_consensus.cc:348] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b516efcba6b3485fba4384f40f3bdf17" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42613 } }
I20260812 16:43:41.470537 10833 raft_consensus.cc:374] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:43:41.470574 10833 raft_consensus.cc:729] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b516efcba6b3485fba4384f40f3bdf17, State: Initialized, Role: FOLLOWER
I20260812 16:43:41.470736 10833 consensus_queue.cc:260] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b516efcba6b3485fba4384f40f3bdf17" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42613 } }
I20260812 16:43:41.470815 10833 raft_consensus.cc:388] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:43:41.470849 10833 raft_consensus.cc:482] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:43:41.470924 10833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:43:41.471740 10833 raft_consensus.cc:504] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b516efcba6b3485fba4384f40f3bdf17" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42613 } }
I20260812 16:43:41.471858 10833 leader_election.cc:302] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b516efcba6b3485fba4384f40f3bdf17; no voters:
I20260812 16:43:41.472054 10833 leader_election.cc:288] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:43:41.472114 10839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:43:41.472388 10839 raft_consensus.cc:686] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [term 1 LEADER]: Becoming Leader. State: Replica: b516efcba6b3485fba4384f40f3bdf17, State: Running, Role: LEADER
I20260812 16:43:41.472518 10833 sys_catalog.cc:564] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:43:41.472545 10839 consensus_queue.cc:237] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b516efcba6b3485fba4384f40f3bdf17" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42613 } }
I20260812 16:43:41.472980 10839 sys_catalog.cc:455] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b516efcba6b3485fba4384f40f3bdf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b516efcba6b3485fba4384f40f3bdf17" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42613 } } }
I20260812 16:43:41.473112 10839 sys_catalog.cc:458] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [sys.catalog]: This master's current role is: LEADER
I20260812 16:43:41.473291 10839 sys_catalog.cc:455] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b516efcba6b3485fba4384f40f3bdf17. Latest consensus state: current_term: 1 leader_uuid: "b516efcba6b3485fba4384f40f3bdf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b516efcba6b3485fba4384f40f3bdf17" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42613 } } }
I20260812 16:43:41.473413 10839 sys_catalog.cc:458] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17 [sys.catalog]: This master's current role is: LEADER
I20260812 16:43:41.473567 10852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 16:43:41 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:43:41.474151 10852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:43:41.474509 10833 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 16:43:41.482113 10837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:41.465441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56618 (local address 127.21.114.126:42613)
0812 16:43:41.465646 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:41.465656 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:41.465692 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:43:41.466288 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:41.466297 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:41.466381 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:41.466530 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:43:41.467402 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:41.469148 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:41.470231 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:41.470875 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:41.470997 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:41.474351 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:43:41.474355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:43:41.474356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:43:41.474368 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:43:41.480204 (+ 5836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:41.480781 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:41.480784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:41.480784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:41.480896 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:41.481131 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:41.481132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:41.481133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:41.481407 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:43:41.481565 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:41.481682 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 16:43:41.481857 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":91,"threads_started":1}
I20260812 16:43:41.488814 10852 catalog_manager.cc:1347] Generated new cluster ID: fc3da3ae90e54739b7552aabd06166b0
I20260812 16:43:41.488878 10852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:43:41.507579 10852 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:43:41.508486 10852 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:43:41.512686 10852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17: Generated new TSK 0
I20260812 16:43:41.512955 10852 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:43:42.283070 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:45741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42613
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:43:42.420707 10915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:43:42.421073 10915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:43:42.421149 10915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:43:42.423007 10915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:43:42.423075 10915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:43:42.423117 10915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:43:42.425457 10915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.21.114.84:45741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:43:42.425704 10915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:43:42.425995 10915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:43:42.431993 10928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:43:42.431984 10925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:43:42.432049 10924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:43:42.432319 10915 server_base.cc:1034] running on GCE node
I20260812 16:43:42.432533 10915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:43:42.432770 10915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:43:42.433930 10915 hybrid_clock.cc:648] HybridClock initialized: now 1786553022433918 us; error 32 us; skew 500 ppm
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:43:42.441614 10915 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:43:42.442142 10915 webserver.cc:460] Webserver started at http://127.21.114.65:35349/ using document root <none> and password file <none>
I20260812 16:43:42.442420 10915 fs_manager.cc:359] Metadata directory not provided
I20260812 16:43:42.442494 10915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:43:42.442657 10915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:43:42.456874 10915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "500c57df5bb84af3a5c0bcb44de56438"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "f5c95fc95e262d8d2704286bc7604454"
server_key_iv: "564c06cdc1a28cb909adf106b9b6fda1"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.457448 10915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "500c57df5bb84af3a5c0bcb44de56438"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "f5c95fc95e262d8d2704286bc7604454"
server_key_iv: "564c06cdc1a28cb909adf106b9b6fda1"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.464720 10915 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260812 16:43:42.480482 10943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:42.480741 10915 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 16:43:42.480832 10915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "500c57df5bb84af3a5c0bcb44de56438"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "f5c95fc95e262d8d2704286bc7604454"
server_key_iv: "564c06cdc1a28cb909adf106b9b6fda1"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.480922 10915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:43:42.503512 10915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:43:42.506237 10915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:43:42.506444 10915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:43:42.506757 10915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:43:42.507184 10915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:43:42.507278 10915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:42.507344 10915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:43:42.507395 10915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:42.519172 10915 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:43625
I20260812 16:43:42.519295 11149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:43625 every 8 connection(s)
I20260812 16:43:42.519671 10915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:43:42.525086 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 10915
I20260812 16:43:42.525242 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:43:42.525517 21961 external_mini_cluster.cc:1428] Setting key dfe375e3740c07a70d2e0241ed4a6e7e
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:43:42.530598 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:42.520710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:60475 (local address 127.21.114.126:42613)
0812 16:43:42.520855 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:42.520857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:42.521013 (+ 156us) server_negotiation.cc:407] Connection header received
0812 16:43:42.521780 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:42.521782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:42.521801 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:42.521875 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:43:42.522539 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.523148 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.524290 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.524544 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.524644 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:42.527216 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:43:42.527218 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:43:42.527218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:43:42.527227 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:43:42.528928 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:42.529463 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:42.529465 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:42.529465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:42.529556 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:42.529855 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:42.529856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:42.529857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:42.529992 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:43:42.530081 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:42.530391 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 16:43:42.530492 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260812 16:43:42.530951 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:42.520630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42613 (local address 127.21.114.65:60475)
0812 16:43:42.520868 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:42.520915 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:42.521581 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:42.521966 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:42.521970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:42.522206 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:43:42.522428 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:42.522433 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.523258 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.523259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:42.524155 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:42.524158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.524657 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.524658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:42.524800 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:42.525431 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:43:42.525441 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:43:42.527088 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:43:42.529038 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:43:42.529052 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:43:42.529055 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:43:42.529367 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:43:42.529643 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:43:42.529644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:43:42.529645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:43:42.529771 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:43:42.530072 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:43:42.530078 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:43:42.530233 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 16:43:42.530352 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 16:43:42.530517 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":122,"threads_started":1}
I20260812 16:43:42.531507 11151 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42613
I20260812 16:43:42.531642 11151 heartbeater.cc:464] Registering TS with master...
I20260812 16:43:42.531847 11151 heartbeater.cc:511] Master 127.21.114.126:42613 requested a full tablet report, sending...
I20260812 16:43:42.532531 10777 ts_manager.cc:194] Registered new tserver with Master: 500c57df5bb84af3a5c0bcb44de56438 (127.21.114.65:43625)
I20260812 16:43:42.533499 10777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:60475
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:43:42.564874 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:45741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42613
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 16:43:42.704901 11164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:43:42.705235 11164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:43:42.705298 11164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:43:42.707207 11164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:43:42.707324 11164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:43:42.707414 11164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:43:42.709723 11164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.21.114.84:45741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:43:42.710012 11164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:43:42.710351 11164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:43:42.717851 11177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:43:42.718109 11179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:43:42.718472 11164 server_base.cc:1034] running on GCE node
W20260812 16:43:42.718477 11182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:43:42.718855 11164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:43:42.719146 11164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:43:42.720356 11164 hybrid_clock.cc:648] HybridClock initialized: now 1786553022720323 us; error 45 us; skew 500 ppm
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:43:42.724560 11164 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:43:42.725163 11164 webserver.cc:460] Webserver started at http://127.21.114.66:33135/ using document root <none> and password file <none>
I20260812 16:43:42.725543 11164 fs_manager.cc:359] Metadata directory not provided
I20260812 16:43:42.725674 11164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:43:42.725895 11164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:43:42.745985 11164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "fe454c78e49349c6962e3572d67656a4"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "e85f18d54391a3a2bfb925e864e0007f"
server_key_iv: "4fb4b1cec3d46b3724e53b8ce00c0666"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.749774 11164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "fe454c78e49349c6962e3572d67656a4"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "e85f18d54391a3a2bfb925e864e0007f"
server_key_iv: "4fb4b1cec3d46b3724e53b8ce00c0666"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.752664 11164 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 16:43:42.765190 11199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:42.765473 11164 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:43:42.765653 11164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "fe454c78e49349c6962e3572d67656a4"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "e85f18d54391a3a2bfb925e864e0007f"
server_key_iv: "4fb4b1cec3d46b3724e53b8ce00c0666"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.765863 11164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:43:42.781163 11164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:43:42.783702 11164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:43:42.783912 11164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:43:42.784240 11164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:43:42.784720 11164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:43:42.784844 11164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:42.784916 11164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:43:42.784966 11164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:42.799381 11164 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:35499
I20260812 16:43:42.799968 11164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:43:42.808454 11409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:35499 every 8 connection(s)
I20260812 16:43:42.809239 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 11164
I20260812 16:43:42.809355 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:43:42.809544 21961 external_mini_cluster.cc:1428] Setting key c27532ff69bb898895930fc24eca2a55
I20260812 16:43:42.812628 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:42.800819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:50551 (local address 127.21.114.126:42613)
0812 16:43:42.800873 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:42.800876 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:42.801185 (+ 309us) server_negotiation.cc:407] Connection header received
0812 16:43:42.801861 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:42.801862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:42.801883 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:42.801977 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:43:42.802698 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.803635 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.805231 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.805595 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.805690 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:42.808694 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:43:42.808696 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:43:42.808696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:43:42.808705 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:43:42.810742 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:42.811319 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:42.811320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:42.811321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:42.811392 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:42.811702 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:42.811703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:42.811704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:42.811870 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:43:42.811919 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:42.812411 (+ 492us) server_negotiation.cc:299] Negotiation successful
0812 16:43:42.812518 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:43:42.813246 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:42.800773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42613 (local address 127.21.114.66:50551)
0812 16:43:42.801041 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:42.801081 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:42.801710 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:42.802057 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:42.802062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:42.802315 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:43:42.802589 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:42.802595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.803757 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.803758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:42.805123 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:42.805126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:42.805707 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:42.805708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:42.805865 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:42.806487 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:43:42.806497 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:43:42.808528 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:43:42.810852 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:43:42.810860 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:43:42.810862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:43:42.811209 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:43:42.811471 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:43:42.811472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:43:42.811472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:43:42.811609 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:43:42.811975 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:43:42.811983 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:43:42.812177 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 16:43:42.812748 (+ 571us) client_negotiation.cc:240] Negotiation successful
0812 16:43:42.812940 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":96,"threads_started":1}
I20260812 16:43:42.813845 11412 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42613
I20260812 16:43:42.813943 11412 heartbeater.cc:464] Registering TS with master...
I20260812 16:43:42.814124 11412 heartbeater.cc:511] Master 127.21.114.126:42613 requested a full tablet report, sending...
I20260812 16:43:42.814446 10777 ts_manager.cc:194] Registered new tserver with Master: fe454c78e49349c6962e3572d67656a4 (127.21.114.66:35499)
I20260812 16:43:42.814941 10777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:50551
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:43:42.847599 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:45741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42613
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:35893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:43:42.951393 11418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:43:42.951632 11418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:43:42.951673 11418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:43:42.953127 11418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:43:42.953235 11418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:43:42.953299 11418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:43:42.955610 11418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:35893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.21.114.84:45741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:43:42.955883 11418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:43:42.956138 11418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:43:42.961973 11425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:43:42.961993 11431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:43:42.962165 11424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:43:42.962236 11418 server_base.cc:1034] running on GCE node
I20260812 16:43:42.962596 11418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:43:42.962841 11418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:43:42.964020 11418 hybrid_clock.cc:648] HybridClock initialized: now 1786553022964000 us; error 32 us; skew 500 ppm
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:43:42.967454 11418 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:43:42.967984 11418 webserver.cc:460] Webserver started at http://127.21.114.67:35467/ using document root <none> and password file <none>
I20260812 16:43:42.968288 11418 fs_manager.cc:359] Metadata directory not provided
I20260812 16:43:42.968394 11418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:43:42.968552 11418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:43:42 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:43:42.981997 11418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "0df3237dae6a463ab69e644fc6e39695"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "892643766f12d1f0e1c1bf7597f16742"
server_key_iv: "4e647a13b433fb003594037e1b1b557f"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.982543 11418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "0df3237dae6a463ab69e644fc6e39695"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "892643766f12d1f0e1c1bf7597f16742"
server_key_iv: "4e647a13b433fb003594037e1b1b557f"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:42.988574 11418 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260812 16:43:43.008416 11443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:43.008711 11418 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 16:43:43.008882 11418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "0df3237dae6a463ab69e644fc6e39695"
format_stamp: "Formatted at 2026-08-12 16:43:42 on dist-test-slave-45dx"
server_key: "892643766f12d1f0e1c1bf7597f16742"
server_key_iv: "4e647a13b433fb003594037e1b1b557f"
server_key_version: "kuduclusterkey@0"
I20260812 16:43:43.009084 11418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:43:43.035296 11418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:43:43.037431 11418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:43:43.037611 11418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:43:43.037882 11418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:43:43.038264 11418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:43:43.038323 11418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:43.038367 11418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:43:43.038394 11418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:43:43.046825 11418 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:38821
I20260812 16:43:43.046933 11642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:38821 every 8 connection(s)
I20260812 16:43:43.047274 11418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:43:43 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:43:43.055259 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 11418
I20260812 16:43:43.055403 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:43:43.055644 21961 external_mini_cluster.cc:1428] Setting key a30c695c4538fbdacbeb955fbddb4d68
I20260812 16:43:43.058595 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.048198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:52943 (local address 127.21.114.126:42613)
0812 16:43:43.048249 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.048251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.048571 (+ 320us) server_negotiation.cc:407] Connection header received
0812 16:43:43.049087 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.049088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.049104 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.049218 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:43:43.049815 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.050755 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.051946 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.052284 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.052436 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.055268 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:43:43.055270 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:43:43.055270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:43:43.055278 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:43:43.057165 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:43.057588 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:43.057589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:43.057589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:43.057651 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:43.057923 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:43.057924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:43.057925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:43.058047 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:43:43.058126 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.058411 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.058505 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:43:43.059105 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.048204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42613 (local address 127.21.114.67:52943)
0812 16:43:43.048431 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.048468 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:43.048969 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:43.049276 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:43.049279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:43.049500 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:43:43.049718 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.049722 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.050866 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.050867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.051847 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.051850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.052522 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.052523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.052646 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.053364 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:43:43.053373 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:43:43.055164 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:43:43.057260 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:43:43.057266 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:43:43.057269 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:43:43.057508 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:43:43.057728 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:43:43.057729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:43:43.057730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:43:43.057847 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:43:43.058117 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:43:43.058124 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:43:43.058268 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 16:43:43.058373 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 16:43:43.058533 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":136,"threads_started":1}
I20260812 16:43:43.061079 11645 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42613
I20260812 16:43:43.061188 11645 heartbeater.cc:464] Registering TS with master...
I20260812 16:43:43.061379 11645 heartbeater.cc:511] Master 127.21.114.126:42613 requested a full tablet report, sending...
I20260812 16:43:43.061843 10777 ts_manager.cc:194] Registered new tserver with Master: 0df3237dae6a463ab69e644fc6e39695 (127.21.114.67:38821)
I20260812 16:43:43.062341 10777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:52943
I20260812 16:43:43.067508 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:43:43.081007 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.072617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36240 (local address 127.21.114.126:42613)
0812 16:43:43.072661 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.072663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.072855 (+ 192us) server_negotiation.cc:407] Connection header received
0812 16:43:43.072892 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.072893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.072906 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.072981 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:43:43.073866 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.074694 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.075818 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.076117 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.076162 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.077856 (+ 1694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:43:43.077857 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:43:43.077858 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:43:43.077865 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:43:43.079716 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:43.080126 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:43.080128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:43.080128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:43.080185 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:43:43.080412 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:43:43.080413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:43:43.080413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:43:43.080539 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:43:43.080613 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.080828 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.080907 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:43:43.083587 10777 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:43:43.085958 10777 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:43:43.094851 11670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.089086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:35499 (local address 127.0.0.1:49304)
0812 16:43:43.089716 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.089762 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:43.089921 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:43.090301 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:43.090305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:43.090307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:43:43.090441 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.090444 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.091888 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.091889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.093239 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.093242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.094466 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.094467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.094574 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.094589 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 16:43:43.094661 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 16:43:43.094717 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":96,"threads_started":1}
I20260812 16:43:43.095367 11671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.089267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49304 (local address 127.21.114.66:35499)
0812 16:43:43.089587 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.089593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.089868 (+ 275us) server_negotiation.cc:407] Connection header received
0812 16:43:43.090066 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.090069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.090086 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.090159 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:43:43.090547 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.091764 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.093390 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.094253 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.094307 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.094397 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.095221 (+ 824us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.095269 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":104,"threads_started":1}
I20260812 16:43:43.095461 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.089467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.21.114.65:43625)
0812 16:43:43.090341 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.090346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.090356 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:43:43.090414 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.090416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.090431 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.090502 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:43:43.090780 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.092324 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.094026 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.094811 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.094881 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.094935 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.095307 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.095358 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":839,"thread_start_us":59,"threads_started":1}
I20260812 16:43:43.095234 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.089361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43625 (local address 127.0.0.1:55036)
0812 16:43:43.090027 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.090037 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:43.090083 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:43.090574 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:43.090575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:43.090576 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:43:43.090678 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.090679 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.092429 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.092430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.093923 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.093926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.094973 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.094974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.095066 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.095070 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:43:43.095122 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:43:43.095159 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":97,"threads_started":1}
I20260812 16:43:43.096553 11269 tablet_service.cc:1467] Processing CreateTablet for tablet 37de7338b645445480ad8ec9f5f9c008 (DEFAULT_TABLE table=test-table [id=0c73fd41577e4e81b930b4b44d0450e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:43:43.096961 11269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37de7338b645445480ad8ec9f5f9c008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:43:43.096942 11027 tablet_service.cc:1467] Processing CreateTablet for tablet 37de7338b645445480ad8ec9f5f9c008 (DEFAULT_TABLE table=test-table [id=0c73fd41577e4e81b930b4b44d0450e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:43:43.097308 11027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37de7338b645445480ad8ec9f5f9c008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:43:43.101588 11682 tablet_bootstrap.cc:492] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: Bootstrap starting.
I20260812 16:43:43.101954 11678 tablet_bootstrap.cc:492] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Bootstrap starting.
I20260812 16:43:43.102363 11682 tablet_bootstrap.cc:654] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: Neither blocks nor log segments found. Creating new log.
I20260812 16:43:43.102758 11682 log.cc:824] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: Log is configured to *not* fsync() on all Append() calls
I20260812 16:43:43.103165 11678 tablet_bootstrap.cc:654] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Neither blocks nor log segments found. Creating new log.
I20260812 16:43:43.103551 11678 log.cc:824] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Log is configured to *not* fsync() on all Append() calls
I20260812 16:43:43.104466 11678 tablet_bootstrap.cc:492] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: No bootstrap required, opened a new log
I20260812 16:43:43.104537 11678 ts_tablet_manager.cc:1397] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:43:43.107093 11678 raft_consensus.cc:348] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.107311 11678 raft_consensus.cc:374] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:43:43.107353 11678 raft_consensus.cc:729] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe454c78e49349c6962e3572d67656a4, State: Initialized, Role: FOLLOWER
I20260812 16:43:43.107499 11678 consensus_queue.cc:260] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.107791 11678 ts_tablet_manager.cc:1428] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:43:43.107851 11412 heartbeater.cc:503] Master 127.21.114.126:42613 was elected leader, sending a full tablet report...
I20260812 16:43:43.108618 11682 tablet_bootstrap.cc:492] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: No bootstrap required, opened a new log
I20260812 16:43:43.108691 11682 ts_tablet_manager.cc:1397] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 16:43:43.109009 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.089581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38821 (local address 127.0.0.1:43742)
0812 16:43:43.090193 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.090202 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:43.090238 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:43.098548 (+ 8310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:43.098549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:43.098552 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:43:43.098606 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.098607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.100014 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.100015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.103082 (+ 3067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.103085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.108762 (+ 5677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.108764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.108834 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.108840 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:43:43.108877 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 16:43:43.108925 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":74,"threads_started":1}
I20260812 16:43:43.109416 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.089761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43742 (local address 127.21.114.67:38821)
0812 16:43:43.098226 (+ 8465us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.098231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.098245 (+ 14us) server_negotiation.cc:407] Connection header received
0812 16:43:43.098295 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.098297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.098314 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.098440 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:43:43.098700 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.099901 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.107225 (+ 7324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.108646 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.109115 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.109232 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.109262 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.109305 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8415,"thread_start_us":148,"threads_started":1}
I20260812 16:43:43.111471 11682 raft_consensus.cc:348] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.111625 11682 raft_consensus.cc:374] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:43:43.111657 11682 raft_consensus.cc:729] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 500c57df5bb84af3a5c0bcb44de56438, State: Initialized, Role: FOLLOWER
I20260812 16:43:43.112936 11540 tablet_service.cc:1467] Processing CreateTablet for tablet 37de7338b645445480ad8ec9f5f9c008 (DEFAULT_TABLE table=test-table [id=0c73fd41577e4e81b930b4b44d0450e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:43:43.113296 11540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37de7338b645445480ad8ec9f5f9c008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:43:43.117004 11682 consensus_queue.cc:260] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.117483 11682 ts_tablet_manager.cc:1428] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260812 16:43:43.118216 11151 heartbeater.cc:503] Master 127.21.114.126:42613 was elected leader, sending a full tablet report...
I20260812 16:43:43.118464 11691 tablet_bootstrap.cc:492] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Bootstrap starting.
I20260812 16:43:43.119642 11691 tablet_bootstrap.cc:654] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Neither blocks nor log segments found. Creating new log.
I20260812 16:43:43.120513 11691 log.cc:824] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Log is configured to *not* fsync() on all Append() calls
I20260812 16:43:43.121474 11691 tablet_bootstrap.cc:492] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: No bootstrap required, opened a new log
I20260812 16:43:43.121553 11691 ts_tablet_manager.cc:1397] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 16:43:43.123878 11691 raft_consensus.cc:348] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.124048 11691 raft_consensus.cc:374] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:43:43.124090 11691 raft_consensus.cc:729] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0df3237dae6a463ab69e644fc6e39695, State: Initialized, Role: FOLLOWER
I20260812 16:43:43.124469 11691 consensus_queue.cc:260] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.124819 11691 ts_tablet_manager.cc:1428] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:43:43.125094 11645 heartbeater.cc:503] Master 127.21.114.126:42613 was elected leader, sending a full tablet report...
Aug 12 16:43:43 dist-test-slave-45dx krb5kdc[9930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553022, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:43:43.218685 11696 raft_consensus.cc:482] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:43:43.218825 11696 raft_consensus.cc:504] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.219261 11696 leader_election.cc:288] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe454c78e49349c6962e3572d67656a4 (127.21.114.66:35499), 500c57df5bb84af3a5c0bcb44de56438 (127.21.114.65:43625)
I20260812 16:43:43.223232 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.219492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:35499 (local address 127.21.114.67:40787)
0812 16:43:43.219766 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.219776 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:43.219823 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:43.220189 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:43.220190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:43.220193 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:43:43.220264 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.220266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.221176 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.221177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.222282 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.222285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.223000 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.223001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.223084 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.223087 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:43:43.223131 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 16:43:43.223165 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258}
I20260812 16:43:43.223721 11671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.219544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:40787 (local address 127.21.114.66:35499)
0812 16:43:43.219591 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.219593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.219929 (+ 336us) server_negotiation.cc:407] Connection header received
0812 16:43:43.219962 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.219962 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.219975 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.220020 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:43:43.220395 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.221049 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.222396 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.222878 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.222947 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.222969 (+ 22us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.223611 (+ 642us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.223650 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:43:43.223984 11327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37de7338b645445480ad8ec9f5f9c008" candidate_uuid: "0df3237dae6a463ab69e644fc6e39695" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe454c78e49349c6962e3572d67656a4" is_pre_election: true
I20260812 16:43:43.224146 11327 raft_consensus.cc:2454] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0df3237dae6a463ab69e644fc6e39695 in term 0.
I20260812 16:43:43.224391 11453 leader_election.cc:302] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df3237dae6a463ab69e644fc6e39695, fe454c78e49349c6962e3572d67656a4; no voters:
I20260812 16:43:43.224529 11696 raft_consensus.cc:2781] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:43:43.224566 11696 raft_consensus.cc:482] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:43:43.224586 11696 raft_consensus.cc:3037] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:43:43.225517 11696 raft_consensus.cc:504] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.225651 11696 leader_election.cc:288] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [CANDIDATE]: Term 1 election: Requested vote from peers fe454c78e49349c6962e3572d67656a4 (127.21.114.66:35499), 500c57df5bb84af3a5c0bcb44de56438 (127.21.114.65:43625)
I20260812 16:43:43.225828 11327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37de7338b645445480ad8ec9f5f9c008" candidate_uuid: "0df3237dae6a463ab69e644fc6e39695" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe454c78e49349c6962e3572d67656a4"
I20260812 16:43:43.225893 11327 raft_consensus.cc:3037] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:43:43.226816 11327 raft_consensus.cc:2454] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0df3237dae6a463ab69e644fc6e39695 in term 1.
I20260812 16:43:43.226995 11453 leader_election.cc:302] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df3237dae6a463ab69e644fc6e39695, fe454c78e49349c6962e3572d67656a4; no voters:
I20260812 16:43:43.227077 11696 raft_consensus.cc:2781] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:43:43.227226 11696 raft_consensus.cc:686] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 1 LEADER]: Becoming Leader. State: Replica: 0df3237dae6a463ab69e644fc6e39695, State: Running, Role: LEADER
I20260812 16:43:43.227319 11696 consensus_queue.cc:237] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } }
I20260812 16:43:43.228179 10777 catalog_manager.cc:5495] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0df3237dae6a463ab69e644fc6e39695 (127.21.114.67). New cstate: current_term: 1 leader_uuid: "0df3237dae6a463ab69e644fc6e39695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0df3237dae6a463ab69e644fc6e39695" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38821 } health_report { overall_health: HEALTHY } } }
I20260812 16:43:43.231899 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.219622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43625 (local address 127.21.114.67:48829)
0812 16:43:43.223297 (+ 3675us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.223308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:43:43.223354 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:43:43.228822 (+ 5468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:43:43.228823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:43:43.228826 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:43:43.228864 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.228865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.229858 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.229858 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.230843 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:43:43.230846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.231696 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.231697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:43:43.231752 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.231755 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:43:43.231798 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 16:43:43.231830 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3666,"thread_start_us":103,"threads_started":1}
I20260812 16:43:43.232245 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.220107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:48829 (local address 127.21.114.65:43625)
0812 16:43:43.220153 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.220155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.223406 (+ 3251us) server_negotiation.cc:407] Connection header received
0812 16:43:43.223433 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.223434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.223464 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.223505 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:43:43.228959 (+ 5454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.229607 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.231032 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.231582 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.231654 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.231663 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.232133 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.232178 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:43:43.232882 11055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37de7338b645445480ad8ec9f5f9c008" candidate_uuid: "0df3237dae6a463ab69e644fc6e39695" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "500c57df5bb84af3a5c0bcb44de56438"
I20260812 16:43:43.233016 11055 raft_consensus.cc:3037] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:43:43.233907 11055 raft_consensus.cc:2454] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0df3237dae6a463ab69e644fc6e39695 in term 1.
I20260812 16:43:43.232901 11035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37de7338b645445480ad8ec9f5f9c008" candidate_uuid: "0df3237dae6a463ab69e644fc6e39695" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "500c57df5bb84af3a5c0bcb44de56438" is_pre_election: true
I20260812 16:43:43.234107 11035 raft_consensus.cc:2362] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0df3237dae6a463ab69e644fc6e39695 in term 1. Re-sending same reply.
I20260812 16:43:43.253968 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.250407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43746 (local address 127.21.114.67:38821)
0812 16:43:43.250452 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:43:43.250455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:43:43.250468 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:43:43.250555 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:43:43.250556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:43:43.250577 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:43:43.250654 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:43:43.250885 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.251613 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.252724 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:43:43.253005 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:43:43.253061 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:43:43.253420 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:43:43.253553 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:43:43.253625 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:43:43.253850 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 16:43:43.253870 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:43:43.256054 11035 raft_consensus.cc:1261] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 1 FOLLOWER]: Refusing update from remote peer 0df3237dae6a463ab69e644fc6e39695: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:43:43.256516 11700 consensus_queue.cc:1035] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [LEADER]: Connected to new peer: Peer: permanent_uuid: "500c57df5bb84af3a5c0bcb44de56438" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:43:43.258518 11327 raft_consensus.cc:1261] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 1 FOLLOWER]: Refusing update from remote peer 0df3237dae6a463ab69e644fc6e39695: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:43:43.258816 11700 consensus_queue.cc:1035] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe454c78e49349c6962e3572d67656a4" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:43:43.261054 11706 mvcc.cc:205] Tried to move back new op lower bound from 7317721183254302720 to 7317721183139758080. Current Snapshot: MvccSnapshot[applied={T|T < 7317721183254302720}]
I20260812 16:43:43.261663 11707 mvcc.cc:205] Tried to move back new op lower bound from 7317721183254302720 to 7317721183139758080. Current Snapshot: MvccSnapshot[applied={T|T < 7317721183254302720}]
I20260812 16:43:43.264020 10774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:43:43.264125 10774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:43:43.265774 10774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b516efcba6b3485fba4384f40f3bdf17: Sending DeleteTablet for 3 replicas of tablet 37de7338b645445480ad8ec9f5f9c008
I20260812 16:43:43.266189 11027 tablet_service.cc:1514] Processing DeleteTablet for tablet 37de7338b645445480ad8ec9f5f9c008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:43:43 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:55036
I20260812 16:43:43.266415 11723 tablet_replica.cc:330] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438: stopping tablet replica
I20260812 16:43:43.266508 11723 raft_consensus.cc:2229] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:43:43.266498 11540 tablet_service.cc:1514] Processing DeleteTablet for tablet 37de7338b645445480ad8ec9f5f9c008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:43:43 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:43742
I20260812 16:43:43.266571 11723 raft_consensus.cc:2258] T 37de7338b645445480ad8ec9f5f9c008 P 500c57df5bb84af3a5c0bcb44de56438 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:43:43.267053 11269 tablet_service.cc:1514] Processing DeleteTablet for tablet 37de7338b645445480ad8ec9f5f9c008 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:43:43 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:49304
I20260812 16:43:43.267230 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 10915
I20260812 16:43:43.280427 11725 tablet_replica.cc:330] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: stopping tablet replica
I20260812 16:43:43.280606 11725 raft_consensus.cc:2229] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:43:43.280771 11725 raft_consensus.cc:2258] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:43:43.283285 11725 ts_tablet_manager.cc:1905] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:43:43.285717 11725 ts_tablet_manager.cc:1918] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:43:43.285831 11725 log.cc:1196] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/37de7338b645445480ad8ec9f5f9c008
I20260812 16:43:43.286216 11725 ts_tablet_manager.cc:1939] T 37de7338b645445480ad8ec9f5f9c008 P 0df3237dae6a463ab69e644fc6e39695: Deleting consensus metadata
I20260812 16:43:43.286813 10755 catalog_manager.cc:4841] TS 0df3237dae6a463ab69e644fc6e39695 (127.21.114.67:38821): tablet 37de7338b645445480ad8ec9f5f9c008 (table test-table [id=0c73fd41577e4e81b930b4b44d0450e9]) successfully deleted
I20260812 16:43:43.340539 11727 tablet_replica.cc:330] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: stopping tablet replica
I20260812 16:43:43.340739 11727 raft_consensus.cc:2229] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:43:43.340891 11727 raft_consensus.cc:2258] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:43:43.341426 11727 ts_tablet_manager.cc:1905] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:43:43.343479 11727 ts_tablet_manager.cc:1918] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:43:43.343583 11727 log.cc:1196] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/37de7338b645445480ad8ec9f5f9c008
I20260812 16:43:43.343890 11727 ts_tablet_manager.cc:1939] T 37de7338b645445480ad8ec9f5f9c008 P fe454c78e49349c6962e3572d67656a4: Deleting consensus metadata
I20260812 16:43:43.344489 10752 catalog_manager.cc:4841] TS fe454c78e49349c6962e3572d67656a4 (127.21.114.66:35499): tablet 37de7338b645445480ad8ec9f5f9c008 (table test-table [id=0c73fd41577e4e81b930b4b44d0450e9]) successfully deleted
W20260812 16:43:43.346720 10751 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:43625 (error 108)
I20260812 16:43:43.347332 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:43:43.347166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43625 (local address 127.0.0.1:55052)
0812 16:43:43.347233 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 16:43:43.347289 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 16:43:43.347465 10751 catalog_manager.cc:4584] TS 500c57df5bb84af3a5c0bcb44de56438 (127.21.114.65:43625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37de7338b645445480ad8ec9f5f9c008: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43625: connect: Connection refused (error 111)
I20260812 16:43:43.347787 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 11164
I20260812 16:43:43.360466 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 11418
I20260812 16:43:43.393015 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 10712
I20260812 16:43:43.409036 21961 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 16:43:43.754621 21961 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 16:43:43.754729 21961 mini_ranger.cc:66] Stopping Ranger...
I20260812 16:43:44.099906 21961 mini_ranger.cc:68] Stopped Ranger
2026-08-12 16:43:44.100 UTC [9985] LOG: received smart shutdown request
2026-08-12 16:43:44.104 UTC [9985] LOG: background worker "logical replication launcher" (PID 10000) exited with exit code 1
2026-08-12 16:43:44.104 UTC [9992] LOG: shutting down
2026-08-12 16:43:44.276 UTC [9985] LOG: database system is shut down
2026-08-12T16:43:44Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47606 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:43:44 dist-test-slave-45dx krb5kdc[11747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:43:44 dist-test-slave-45dx krb5kdc[11747](info): set up 2 sockets
Aug 12 16:43:44 dist-test-slave-45dx krb5kdc[11747](info): commencing operation
krb5kdc: starting...
W20260812 16:43:45.758800 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:43:45 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:43:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:43:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/rangeradmin_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/rangeradmin_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/rangerlookup_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/rangerlookup_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
I20260812 16:43:45.928238 21961 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskP_fNe3/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/postgres -l logfile start
2026-08-12 16:43:48.382 UTC [11798] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 16:43:48.382 UTC [11798] LOG: listening on IPv4 address "127.21.114.84", port 50909
2026-08-12 16:43:48.386 UTC [11798] LOG: listening on Unix socket "/tmp/.s.PGSQL.50909"
2026-08-12 16:43:48.423 UTC [11803] LOG: database system was shut down at 2026-08-12 16:43:47 UTC
2026-08-12 16:43:48.427 UTC [11798] LOG: database system is ready to accept connections
I20260812 16:43:49.681367 21961 mini_postgres.cc:96] Postgres bound to 50909
2026-08-12 16:43:49.688 UTC [11822] FATAL: database "slave" does not exist
127.21.114.84:50909 - accepting connections
I20260812 16:43:49.689080 21961 mini_ranger.cc:161] Starting Ranger...
I20260812 16:43:49.704149 21961 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 16:43:50.196436 21961 mini_ranger.cc:87] Created ranger Postgres database
I20260812 16:43:50.196527 21961 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-admin
2026-08-12 16:43:50,487 [I] DB FLAVOR :POSTGRES
2026-08-12 16:43:50,488 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 16:43:50,488 [I] Checking connection..
2026-08-12 16:43:50,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 16:43:50,755 [I] Checking connection passed.
2026-08-12 16:43:50,756 [I] --------- Verifying version history table ---------
2026-08-12 16:43:50,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 16:43:51,023 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 16:43:51,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 16:43:51,261 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 16:43:51,262 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 16:43:51,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 16:43:51.522 UTC [11920] WARNING: there is no transaction in progress
2026-08-12 16:43:51,529 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 16:43:51,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 16:43:51,785 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 16:43:51,786 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 16:43:51,786 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 16:43:52,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 16:43:52,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-45dx.c.gcp-upstream.internal','N') ;"
2026-08-12 16:43:52,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 16:43:52,772 [I] Table x_portal_user does not exist in database ranger
2026-08-12 16:43:52,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 16:43:53,016 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 16:43:53,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 16:43:53,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 16:43:53,534 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 16:43:53,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 16:43:54.509 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.526 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.543 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.559 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.576 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.593 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.648 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.656 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.670 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.681 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.691 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.705 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.714 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.721 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.729 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:54.736 UTC [12121] WARNING: there is no transaction in progress
2026-08-12 16:43:55,362 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 16:43:55,362 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 16:43:55,600 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 16:43:55,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 16:43:55,855 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 16:43:55,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 16:43:56,123 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 16:43:56,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 16:43:56,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 16:43:56,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-45dx.c.gcp-upstream.internal';"
2026-08-12 16:43:56,861 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 16:43:56,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 16:43:57,100 [I] DB_PATCHES have already been applied
I20260812 16:43:57.106310 21961 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-admin:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskP_fNe3/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 16:43:57.106388 21961 mini_ranger.cc:193] Using host: 127.21.114.84
I20260812 16:43:57.110539 21961 mini_ranger.cc:227] Ranger admin URL: http://127.21.114.84:46615
Aug 12, 2026 4:43:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 4:43:57 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 4:43:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 4:43:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 4:43:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 4:43:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 4:43:58 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 16:43:58.543181 21961 mini_ranger.cc:160] Time spent starting Ranger: real 8.854s user 0.001s sys 0.009s
Aug 12, 2026 4:44:18 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 4:44:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 4:44:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 4:44:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 4:44:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 4:44:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 4:44:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 4:44:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 4:44:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 4:44:19 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 4:44:19 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 16:44:20.558321 21961 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.21.114.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.21.114.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/rangerkms_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.21.114.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/rangerkms_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.114.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.21.114.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.114.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/HTTP_127.21.114.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 16:44:20 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553060, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 16:44:20.653028 21961 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 16:44:20.662894 21961 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 16:44:21.546913 21961 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 16:44:21.546986 21961 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms
I20260812 16:44:21.546999 21961 mini_ranger_kms.cc:227] Using postgres at 127.21.114.84:50909
2026-08-12 16:44:21,726 [I] DB FLAVOR :POSTGRES
2026-08-12 16:44:21,727 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 16:44:21,727 [I] Checking connection
2026-08-12 16:44:21,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 16:44:21,971 [I] connection success
2026-08-12 16:44:21,972 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 16:44:21,972 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 16:44:21,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 16:44:22,210 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 16:44:22,210 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 16:44:22,210 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 16:44:22,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.114.84:50909/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 16:44:22,504 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 16:44:22.969304 21961 mini_ranger_kms.cc:310] Created kms service
I20260812 16:44:23.175189 21961 mini_ranger_kms.cc:326] Created kudu user
I20260812 16:44:23.221158 21961 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 16:44:23 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553060, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:23.600216 21961 mini_ranger_kms.cc:384] Added ranger policy
I20260812 16:44:23.600570 21961 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms:/tmp/dist-test-taskP_fNe3/build/release/bin/postgresql.jar:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskP_fNe3/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 16:44:23.600615 21961 mini_ranger_kms.cc:240] Using host: 127.21.114.84
I20260812 16:44:23.604928 21961 mini_ranger_kms.cc:276] Ranger KMS PID: 12449
I20260812 16:44:23.605010 21961 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.21.114.84:41775
Aug 12, 2026 4:44:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 4:44:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 4:44:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 4:44:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 4:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 4:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 16:44:26 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786553066, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.114.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:26.547143 21961 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.894s user 0.007s sys 0.156s
I20260812 16:44:26.547267 21961 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 16:44:26.547323 21961 mini_ranger_kms.cc:401] 127.21.114.84:41775/kms/v1/keys
Aug 12 16:44:26 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553066, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.114.84@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
Aug 12 16:44:26 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553066, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.114.84@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
Aug 12 16:44:29 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:44:29.436105 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:34175
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:34175
--ranger_config_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:29.524689 12559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:29.524940 12559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:29.524963 12559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:29.526192 12559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:29.526240 12559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:29.526257 12559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:29.526270 12559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:29.526283 12559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:29.527958 12559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
--ranger_kms_url=127.21.114.84:41775/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:34175
--ranger_config_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:34175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:29.528234 12559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:29.528522 12559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:29.534214 12567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:29.534221 12566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:29.534250 12559 server_base.cc:1034] running on GCE node
W20260812 16:44:29.534677 12570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:29.535022 12559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:29.535374 12559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:29.536546 12559 hybrid_clock.cc:648] HybridClock initialized: now 1786553069536522 us; error 43 us; skew 500 ppm
Aug 12 16:44:29 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553069, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:29.539356 12559 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:29.539805 12559 webserver.cc:460] Webserver started at http://127.21.114.126:34721/ using document root <none> and password file <none>
I20260812 16:44:29.540063 12559 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:29.540127 12559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:29.540283 12559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:44:29 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553069, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:29.586135 12559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "d0bed88e17704ca58cad4f52f2bd3e56"
format_stamp: "Formatted at 2026-08-12 16:44:29 on dist-test-slave-45dx"
server_key: "a6139d4154d1a6c71a21de2a470656e1"
server_key_iv: "d4b4c89bfaf3f406b3a4b198b1bc0b6b"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:29.586661 12559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "d0bed88e17704ca58cad4f52f2bd3e56"
format_stamp: "Formatted at 2026-08-12 16:44:29 on dist-test-slave-45dx"
server_key: "a6139d4154d1a6c71a21de2a470656e1"
server_key_iv: "d4b4c89bfaf3f406b3a4b198b1bc0b6b"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:29.588660 12559 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 16:44:29.600140 12587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:29.600426 12559 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:29.600548 12559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "d0bed88e17704ca58cad4f52f2bd3e56"
format_stamp: "Formatted at 2026-08-12 16:44:29 on dist-test-slave-45dx"
server_key: "a6139d4154d1a6c71a21de2a470656e1"
server_key_iv: "d4b4c89bfaf3f406b3a4b198b1bc0b6b"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:29.600652 12559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:29.614068 12559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:29.616468 12559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:29.616638 12559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:29.622237 12559 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:34175
I20260812 16:44:29.622269 12669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:34175 every 8 connection(s)
I20260812 16:44:29.622769 12559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:29.623260 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 12559
I20260812 16:44:29.623381 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:44:29.623575 21961 external_mini_cluster.cc:1428] Setting key 8c39b76b7efb8ced300bf4006d2c7ccb
I20260812 16:44:29.623701 12670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:29.627211 12670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Bootstrap starting.
I20260812 16:44:29.627897 12670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:29.628211 12670 log.cc:824] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:29.628989 12670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: No bootstrap required, opened a new log
I20260812 16:44:29.631681 12670 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:29.631879 12670 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:29.631945 12670 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0bed88e17704ca58cad4f52f2bd3e56, State: Initialized, Role: FOLLOWER
I20260812 16:44:29.632122 12670 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:29.632222 12670 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:29.632278 12670 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:29.632367 12670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 16:44:29 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:29.633010 12670 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:29.633164 12670 leader_election.cc:302] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0bed88e17704ca58cad4f52f2bd3e56; no voters:
I20260812 16:44:29.633354 12670 leader_election.cc:288] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:44:29.633416 12678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:29.633656 12678 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 LEADER]: Becoming Leader. State: Replica: d0bed88e17704ca58cad4f52f2bd3e56, State: Running, Role: LEADER
I20260812 16:44:29.633806 12678 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:29.633834 12670 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:29.635151 12679 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } } }
I20260812 16:44:29.635239 12679 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:29.635558 12680 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0bed88e17704ca58cad4f52f2bd3e56. Latest consensus state: current_term: 1 leader_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } } }
I20260812 16:44:29.635684 12670 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 16:44:29.635689 12680 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:29.638940 12705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:29.640121 12675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:29.624425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.21.114.126:34175)
0812 16:44:29.624625 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:29.624636 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:29.624673 (+ 37us) server_negotiation.cc:407] Connection header received
0812 16:44:29.625367 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:29.625377 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:29.625448 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:29.625609 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:29.626469 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:29.627925 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:29.629103 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:29.629736 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:29.629857 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:29.632976 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:29.632980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:29.632980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:29.632995 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:29.635225 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:29.635708 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:29.635711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:29.635712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:29.635826 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:29.636071 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:29.636072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:29.636073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:29.636426 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:29.638790 (+ 2364us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:29.639052 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 16:44:29.639762 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
I20260812 16:44:29.640146 12705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:29.648054 12705 catalog_manager.cc:1347] Generated new cluster ID: 68947f92e3eb40f5877f7552759228c5
I20260812 16:44:29.648213 12705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:44:29.670338 12705 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:44:29.671238 12705 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:29.678421 12705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Generated new TSK 0
I20260812 16:44:29.678756 12705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:44:30.462396 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:34175
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:30.588433 12757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:30.588718 12757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:30.588757 12757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:30.590474 12757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:30.590605 12757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:30.590690 12757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:44:30.592993 12757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.21.114.84:41775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:30.593268 12757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:30.593604 12757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:30.600281 12769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:30.600286 12763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:30.600713 12764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:30.601585 12757 server_base.cc:1034] running on GCE node
I20260812 16:44:30.601845 12757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:30.602164 12757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:30.603377 12757 hybrid_clock.cc:648] HybridClock initialized: now 1786553070603339 us; error 52 us; skew 500 ppm
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:30.607445 12757 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:44:30.608036 12757 webserver.cc:460] Webserver started at http://127.21.114.65:40505/ using document root <none> and password file <none>
I20260812 16:44:30.608389 12757 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:30.608522 12757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:30.608680 12757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:30.629992 12757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "91ab989b04ab4bd184ba43fd02516ad0"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "aaa55a6f70754d7023c7b4579e521c2f"
server_key_iv: "a9d3673f2ce8aa2ef65c0a3b2bf75e52"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:30.630436 12757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "91ab989b04ab4bd184ba43fd02516ad0"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "aaa55a6f70754d7023c7b4579e521c2f"
server_key_iv: "a9d3673f2ce8aa2ef65c0a3b2bf75e52"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:30.636739 12757 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.000s
I20260812 16:44:30.651604 12780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:30.651885 12757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:30.651993 12757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "91ab989b04ab4bd184ba43fd02516ad0"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "aaa55a6f70754d7023c7b4579e521c2f"
server_key_iv: "a9d3673f2ce8aa2ef65c0a3b2bf75e52"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:30.652101 12757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:30.670917 12757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:30.673589 12757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:30.673820 12757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:30.674150 12757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:30.674597 12757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:30.674698 12757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:30.674805 12757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:30.674898 12757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:30.686759 12757 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:35269
I20260812 16:44:30.687325 12757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:44:30.687438 12982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:35269 every 8 connection(s)
I20260812 16:44:30.692549 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 12757
I20260812 16:44:30.692659 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:44:30.692853 21961 external_mini_cluster.cc:1428] Setting key 808f70455a5f675a09ed9e7db4783605
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:30.699560 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:30.688389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:34175 (local address 127.21.114.65:53185)
0812 16:44:30.688616 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:30.688661 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:30.689221 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:30.689510 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:30.689515 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:30.689785 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:30.690092 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:30.690100 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.691182 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.691183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:30.692534 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:30.692537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.693146 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.693147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:30.693297 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:30.693961 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:30.693973 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:30.695634 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:30.697821 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:30.697829 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:30.697832 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:30.698162 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:30.698405 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:30.698406 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:30.698406 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:30.698546 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:30.698854 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:30.698872 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:30.699040 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 16:44:30.699151 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 16:44:30.699310 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":115,"threads_started":1}
I20260812 16:44:30.700449 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:30.688398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53185 (local address 127.21.114.126:34175)
0812 16:44:30.688549 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:30.688551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:30.688771 (+ 220us) server_negotiation.cc:407] Connection header received
0812 16:44:30.689349 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:30.689350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:30.689375 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:30.689435 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:30.690238 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.691052 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.692646 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.692976 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.693027 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:30.695748 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:30.695750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:30.695750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:30.695758 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:30.697713 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:30.698258 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:30.698259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:30.698260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:30.698332 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:30.698626 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:30.698627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:30.698627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:30.698772 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:30.698830 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:30.700226 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0812 16:44:30.700346 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260812 16:44:30.702275 12984 heartbeater.cc:347] Connected to a master server at 127.21.114.126:34175
I20260812 16:44:30.702383 12984 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:30.702582 12984 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:30.703197 12614 ts_manager.cc:194] Registered new tserver with Master: 91ab989b04ab4bd184ba43fd02516ad0 (127.21.114.65:35269)
I20260812 16:44:30.704062 12614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:53185
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:44:30.757754 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:34175
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 16:44:30.864185 12998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:30.864573 12998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:30.864639 12998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:30.866364 12998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:30.866449 12998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:30.866508 12998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:44:30.868719 12998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.21.114.84:41775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:30.869114 12998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:30.869443 12998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:30.875972 13012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:30.875973 13010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:30.876418 13009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:30.876643 12998 server_base.cc:1034] running on GCE node
I20260812 16:44:30.876847 12998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:30.877076 12998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:30.878254 12998 hybrid_clock.cc:648] HybridClock initialized: now 1786553070878234 us; error 34 us; skew 500 ppm
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:30.881065 12998 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:44:30.881583 12998 webserver.cc:460] Webserver started at http://127.21.114.66:42315/ using document root <none> and password file <none>
I20260812 16:44:30.881860 12998 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:30.881934 12998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:30.882078 12998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:30.893808 12998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "b1200b4579b84b7fbb63879ee5cd6075"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "5288ae0b07bdaeb8b1a43e8ada00f7fa"
server_key_iv: "e2fdb41008485781cb82e349f48979ac"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:30.894556 12998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "b1200b4579b84b7fbb63879ee5cd6075"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "5288ae0b07bdaeb8b1a43e8ada00f7fa"
server_key_iv: "e2fdb41008485781cb82e349f48979ac"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:30.898518 12998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260812 16:44:30.910127 13026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:30.910310 12998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:30.910414 12998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "b1200b4579b84b7fbb63879ee5cd6075"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "5288ae0b07bdaeb8b1a43e8ada00f7fa"
server_key_iv: "e2fdb41008485781cb82e349f48979ac"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:30.910509 12998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:30.923893 12998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:30.926508 12998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:30.926740 12998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:30.927042 12998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:30.927506 12998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:30.927603 12998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:30.927696 12998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:30.927763 12998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:30.937271 12998 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:45771
I20260812 16:44:30.937819 12998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:44:30.939517 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 12998
I20260812 16:44:30.939634 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:44:30.939846 21961 external_mini_cluster.cc:1428] Setting key 78a284212d9784929b8e14a0f02addd0
I20260812 16:44:30.943065 13226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:45771 every 8 connection(s)
Aug 12 16:44:30 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553070, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
I20260812 16:44:30.957135 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:30.944155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:34251 (local address 127.21.114.126:34175)
0812 16:44:30.944201 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:30.944204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:30.946278 (+ 2074us) server_negotiation.cc:407] Connection header received
0812 16:44:30.947043 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:30.947044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:30.947057 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:30.947087 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:30.947986 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.948723 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.950151 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.950511 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.950561 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:30.953531 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:30.953533 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:30.953533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:30.953543 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:30.955430 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:30.955974 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:30.955975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:30.955976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:30.956036 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:30.956348 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:30.956349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:30.956350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:30.956491 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:30.956535 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:30.956941 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 16:44:30.957036 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:44:30.957962 13234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:30.943863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:34175 (local address 127.21.114.66:34251)
0812 16:44:30.946131 (+ 2268us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:30.946184 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:30.946911 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:30.947292 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:30.947296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:30.947573 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:30.947876 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:30.947883 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.948843 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.948844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:30.950041 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:30.950044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:30.950674 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:30.950675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:30.950833 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:30.951514 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:30.951526 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:30.953413 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:30.955577 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:30.955584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:30.955586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:30.955907 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:30.956113 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:30.956113 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:30.956114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:30.956243 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:30.956584 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:30.956591 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:30.956757 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 16:44:30.957488 (+ 731us) client_negotiation.cc:240] Negotiation successful
0812 16:44:30.957672 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2219,"thread_start_us":87,"threads_started":1}
I20260812 16:44:30.958710 13228 heartbeater.cc:347] Connected to a master server at 127.21.114.126:34175
I20260812 16:44:30.958809 13228 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:30.959008 13228 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:30.959522 12614 ts_manager.cc:194] Registered new tserver with Master: b1200b4579b84b7fbb63879ee5cd6075 (127.21.114.66:45771)
I20260812 16:44:30.960137 12614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:34251
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:44:30.980468 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:34175
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:31.109754 13236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:31.110126 13236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:31.110222 13236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:31.111949 13236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:31.112062 13236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:31.112152 13236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:44:31.114354 13236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.21.114.84:41775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:31.114830 13236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:31.115125 13236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:31.121548 13246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:31.121560 13244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.122339 13236 server_base.cc:1034] running on GCE node
W20260812 16:44:31.122418 13242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.122673 13236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:31.122947 13236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:31.124126 13236 hybrid_clock.cc:648] HybridClock initialized: now 1786553071124103 us; error 35 us; skew 500 ppm
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:31.127537 13236 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:44:31.128082 13236 webserver.cc:460] Webserver started at http://127.21.114.67:45401/ using document root <none> and password file <none>
I20260812 16:44:31.128376 13236 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:31.128444 13236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:31.128628 13236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:31.143033 13236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "00eae60325724711bbea14e325bb1c1c"
format_stamp: "Formatted at 2026-08-12 16:44:31 on dist-test-slave-45dx"
server_key: "8955525b05e4a5d0aa2b5fecf252c4ef"
server_key_iv: "dfbd9409c5b7a367bf21eacba9e94a07"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:31.143491 13236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "00eae60325724711bbea14e325bb1c1c"
format_stamp: "Formatted at 2026-08-12 16:44:31 on dist-test-slave-45dx"
server_key: "8955525b05e4a5d0aa2b5fecf252c4ef"
server_key_iv: "dfbd9409c5b7a367bf21eacba9e94a07"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:31.145318 13236 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 16:44:31.157605 13256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.157840 13236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:31.157927 13236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "00eae60325724711bbea14e325bb1c1c"
format_stamp: "Formatted at 2026-08-12 16:44:31 on dist-test-slave-45dx"
server_key: "8955525b05e4a5d0aa2b5fecf252c4ef"
server_key_iv: "dfbd9409c5b7a367bf21eacba9e94a07"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:31.158005 13236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:31.224840 13236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:31.227450 13236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:31.227653 13236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:31.227907 13236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:31.228379 13236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:31.228472 13236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.228542 13236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:31.228600 13236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.235129 13236 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:40937
I20260812 16:44:31.235625 13236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:44:31.245565 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 13236
I20260812 16:44:31.245707 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:44:31.245918 21961 external_mini_cluster.cc:1428] Setting key a37f78712fce8ffa800175c6d878eec5
I20260812 16:44:31.255554 13446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:40937 every 8 connection(s)
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:31.264634 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:31.236890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:41023 (local address 127.21.114.126:34175)
0812 16:44:31.236940 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:31.236942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:31.245688 (+ 8746us) server_negotiation.cc:407] Connection header received
0812 16:44:31.246466 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:31.246467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:31.246482 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:31.246516 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:31.247457 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.248280 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.249959 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.250242 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.250292 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:31.258294 (+ 8002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:31.258295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:31.258296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:31.258304 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:31.260125 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:31.260731 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:31.260733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:31.260733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:31.260795 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:31.261086 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:31.261087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:31.261087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:31.261229 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:31.261281 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:31.264428 (+ 3147us) server_negotiation.cc:299] Negotiation successful
0812 16:44:31.264533 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:44:31.265443 13454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:31.236900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:34175 (local address 127.21.114.67:41023)
0812 16:44:31.245495 (+ 8595us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:31.245559 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:31.246320 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:31.246730 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:31.246736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:31.247021 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:31.247320 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:31.247340 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.248428 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.248429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:31.249740 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:31.249743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.250433 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.250433 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:31.250578 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:31.256379 (+ 5801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:31.256390 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:31.258178 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:31.260237 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:31.260247 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:31.260249 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:31.260631 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:31.260871 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:31.260872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:31.260872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:31.261009 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:31.261317 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:31.261336 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:31.261524 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 16:44:31.264998 (+ 3474us) client_negotiation.cc:240] Negotiation successful
0812 16:44:31.265183 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8539,"thread_start_us":86,"threads_started":1}
I20260812 16:44:31.266140 13448 heartbeater.cc:347] Connected to a master server at 127.21.114.126:34175
I20260812 16:44:31.266258 13448 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:31.266502 13448 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:31.266917 12614 ts_manager.cc:194] Registered new tserver with Master: 00eae60325724711bbea14e325bb1c1c (127.21.114.67:40937)
I20260812 16:44:31.267482 12614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:41023
I20260812 16:44:31.272341 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:44:31.273111 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 12757
I20260812 16:44:31.308799 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 12998
I20260812 16:44:31.350106 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 13236
I20260812 16:44:31.360970 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 12559
I20260812 16:44:31.375474 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:34175
--webserver_interface=127.21.114.126
--webserver_port=34721
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:34175
--ranger_config_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:31.475746 13456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:31.475975 13456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:31.475996 13456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:31.477136 13456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:31.477174 13456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:31.477188 13456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:31.477201 13456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:31.477212 13456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:31.478740 13456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:34175
--ranger_config_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:34175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=34721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:31.478937 13456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:31.479111 13456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:31.484004 13464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:31.483991 13463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.484198 13456 server_base.cc:1034] running on GCE node
W20260812 16:44:31.484010 13468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.484562 13456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:31.484807 13456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:31.485996 13456 hybrid_clock.cc:648] HybridClock initialized: now 1786553071485986 us; error 31 us; skew 500 ppm
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:31.488524 13456 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:31.489004 13456 webserver.cc:460] Webserver started at http://127.21.114.126:34721/ using document root <none> and password file <none>
I20260812 16:44:31.489238 13456 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:31.489315 13456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:31.570807 13456 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:31.571628 13478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.571902 13456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:31.572027 13456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "d0bed88e17704ca58cad4f52f2bd3e56"
format_stamp: "Formatted at 2026-08-12 16:44:29 on dist-test-slave-45dx"
server_key: "a6139d4154d1a6c71a21de2a470656e1"
server_key_iv: "d4b4c89bfaf3f406b3a4b198b1bc0b6b"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:31.572539 13456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:31.584870 13456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:31.586436 13456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:31.586546 13456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:31.590731 13456 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:34175
I20260812 16:44:31.590782 13570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:34175 every 8 connection(s)
I20260812 16:44:31.591169 13456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:31.592422 13571 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:44:31.592852 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 13456
I20260812 16:44:31.593175 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:35269
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:34175
--webserver_port=40505
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:31.593366 13571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Bootstrap starting.
I20260812 16:44:31.601718 13571 log.cc:824] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:31.603509 13571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:31.603806 13571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Bootstrap complete.
I20260812 16:44:31.606184 13571 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:31.606417 13571 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0bed88e17704ca58cad4f52f2bd3e56, State: Initialized, Role: FOLLOWER
I20260812 16:44:31.606598 13571 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:31.606662 13571 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:31.606724 13571 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:31.606774 13571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:44:31.607826 13571 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:31.607942 13571 leader_election.cc:302] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0bed88e17704ca58cad4f52f2bd3e56; no voters:
I20260812 16:44:31.608145 13571 leader_election.cc:288] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 16:44:31.608186 13581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 16:44:31.608337 13581 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [term 2 LEADER]: Becoming Leader. State: Replica: d0bed88e17704ca58cad4f52f2bd3e56, State: Running, Role: LEADER
I20260812 16:44:31.608439 13581 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } }
I20260812 16:44:31.608474 13571 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:31.608721 13581 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0bed88e17704ca58cad4f52f2bd3e56. Latest consensus state: current_term: 2 leader_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } } }
I20260812 16:44:31.608803 13581 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:31.608728 13584 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0bed88e17704ca58cad4f52f2bd3e56" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 34175 } } }
I20260812 16:44:31.608994 13584 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:31.609009 13594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:31.609640 13594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:31.609812 13594 catalog_manager.cc:1259] Loaded cluster ID: 68947f92e3eb40f5877f7552759228c5
I20260812 16:44:31.609887 13594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:44:31.610003 13571 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 16:44:31.613724 13594 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:31.614291 13594 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Loaded TSK: 0
I20260812 16:44:31.614589 13594 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 16:44:31.708150 13574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:31.708444 13574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:31.708482 13574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:31.710251 13574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:31.710302 13574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:31.710340 13574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:44:31.712484 13574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:35269
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=40505
--tserver_master_addrs=127.21.114.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:31.712714 13574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:31.712981 13574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:31.719697 13652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:31.721397 13645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:31.721591 13646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.722683 13574 server_base.cc:1034] running on GCE node
I20260812 16:44:31.722939 13574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:31.723239 13574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:31.724377 13574 hybrid_clock.cc:648] HybridClock initialized: now 1786553071724351 us; error 38 us; skew 500 ppm
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:31.727548 13574 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:44:31.728086 13574 webserver.cc:460] Webserver started at http://127.21.114.65:40505/ using document root <none> and password file <none>
I20260812 16:44:31.728395 13574 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:31.728487 13574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:31.753103 13574 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260812 16:44:31.753811 13665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.753953 13574 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:31.754033 13574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "91ab989b04ab4bd184ba43fd02516ad0"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "aaa55a6f70754d7023c7b4579e521c2f"
server_key_iv: "a9d3673f2ce8aa2ef65c0a3b2bf75e52"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:31.755259 13574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:31.784399 13574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:31.786644 13574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:31.786803 13574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:31.787070 13574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:31.787470 13574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:31.787528 13574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.787568 13574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:31.787597 13574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.795188 13574 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:35269
I20260812 16:44:31.795323 13877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:35269 every 8 connection(s)
I20260812 16:44:31.795697 13574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:44:31.800675 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 13574
I20260812 16:44:31.800997 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:45771
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:34175
--webserver_port=42315
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:31.817025 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:31.798516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:34175 (local address 127.21.114.65:55831)
0812 16:44:31.798714 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:31.798774 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:31.799418 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:31.799908 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:31.799912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:31.800126 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:31.800358 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:31.800365 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.801716 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.801717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:31.802586 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:31.802590 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.803495 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.803496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:31.803652 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:31.805948 (+ 2296us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:31.805959 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:31.812642 (+ 6683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:31.815031 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:31.815038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:31.815041 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:31.815371 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:31.815673 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:31.815674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:31.815674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:31.815799 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:31.816295 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:31.816323 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:31.816482 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 16:44:31.816592 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 16:44:31.816768 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260812 16:44:31.817907 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:31.798661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:55831 (local address 127.21.114.126:34175)
0812 16:44:31.798852 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:31.798861 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:31.798907 (+ 46us) server_negotiation.cc:407] Connection header received
0812 16:44:31.799652 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:31.799659 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:31.799716 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:31.799868 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:31.800496 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.801610 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.802703 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:31.803363 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:31.803501 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:31.812785 (+ 9284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:31.812790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:31.812790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:31.812803 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:31.814926 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:31.815478 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:31.815482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:31.815482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:31.815597 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:31.815866 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:31.815867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:31.815867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:31.816181 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:31.816264 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:31.817560 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0812 16:44:31.817696 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260812 16:44:31.818730 13879 heartbeater.cc:347] Connected to a master server at 127.21.114.126:34175
I20260812 16:44:31.818835 13879 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:31.819046 13879 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
W20260812 16:44:31.819944 13879 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:34175 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 16:44:31.820024 13879 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:31.820099 13879 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:31.820663 13879 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:31.820753 13879 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
W20260812 16:44:31.821092 13879 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 16:44:31.926383 13884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:31.926681 13884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:31.926720 13884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:31.928457 13884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:31.928514 13884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:31.928555 13884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:44:31.930717 13884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:45771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=42315
--tserver_master_addrs=127.21.114.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:31.931010 13884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:31.931280 13884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:31.939965 13901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:31.939973 13898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.940523 13884 server_base.cc:1034] running on GCE node
W20260812 16:44:31.940594 13896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:31.940878 13884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:31.941184 13884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:31.942378 13884 hybrid_clock.cc:648] HybridClock initialized: now 1786553071942344 us; error 48 us; skew 500 ppm
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:31.945746 13884 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:44:31.946326 13884 webserver.cc:460] Webserver started at http://127.21.114.66:42315/ using document root <none> and password file <none>
I20260812 16:44:31.946606 13884 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:31.946696 13884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 16:44:31 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:31.967756 13884 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:31.968982 13914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:31.969179 13884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:44:31.969275 13884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "b1200b4579b84b7fbb63879ee5cd6075"
format_stamp: "Formatted at 2026-08-12 16:44:30 on dist-test-slave-45dx"
server_key: "5288ae0b07bdaeb8b1a43e8ada00f7fa"
server_key_iv: "e2fdb41008485781cb82e349f48979ac"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:31.969695 13884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:32.005934 13884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:32.008559 13884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:32.008739 13884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:32.009068 13884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:32.009466 13884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:32.009516 13884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:32.009570 13884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:32.009601 13884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:32.017163 13884 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:45771
I20260812 16:44:32.017557 13884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:44:32.018111 14119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:45771 every 8 connection(s)
I20260812 16:44:32.018659 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 13884
I20260812 16:44:32.018958 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.114.84:41775/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:40937
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:34175
--webserver_port=45401
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:44:32 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553071, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:32.032490 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:32.018430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:50901 (local address 127.21.114.126:34175)
0812 16:44:32.018485 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:32.018486 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:32.020791 (+ 2305us) server_negotiation.cc:407] Connection header received
0812 16:44:32.021636 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:32.021638 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:32.021655 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:32.021741 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:32.022505 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.023374 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.024917 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.025264 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.025349 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:32.028241 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:32.028244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:32.028244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:32.028253 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:32.030635 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:32.031213 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:32.031215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:32.031215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:32.031282 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:32.031604 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:32.031605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:32.031606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:32.031763 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:32.031814 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:32.032255 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 16:44:32.032383 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 16:44:32.033125 14122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:32.018410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:34175 (local address 127.21.114.66:50901)
0812 16:44:32.020445 (+ 2035us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:32.020668 (+ 223us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:32.021506 (+ 838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:32.021841 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:32.021846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:32.022096 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:32.022388 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:32.022396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.023490 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.023491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:32.024824 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:32.024827 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.025390 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.025391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:32.025537 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:32.026210 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:32.026230 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:32.028120 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:32.030759 (+ 2639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:32.030766 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:32.030770 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:32.031112 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:32.031363 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:32.031364 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:32.031364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:32.031515 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:32.031866 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:32.031873 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:32.032057 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 16:44:32.032652 (+ 595us) client_negotiation.cc:240] Negotiation successful
0812 16:44:32.032830 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1989,"thread_start_us":83,"threads_started":1}
I20260812 16:44:32.039248 14120 heartbeater.cc:347] Connected to a master server at 127.21.114.126:34175
I20260812 16:44:32.039369 14120 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.039599 14120 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
W20260812 16:44:32.040275 14120 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:34175 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 16:44:32.040370 14120 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.040444 14120 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:32.040756 14120 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.040855 14120 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
W20260812 16:44:32.041159 14120 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 16:44:32.139015 14124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:32.139312 14124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:32.139382 14124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:32.141103 14124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:32.141160 14124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:32.141199 14124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:44:32.143342 14124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.114.84:41775/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:40937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=45401
--tserver_master_addrs=127.21.114.126:34175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:32.143605 14124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:32.143869 14124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:32.149518 14138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:32.149694 14136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:32.149952 14124 server_base.cc:1034] running on GCE node
W20260812 16:44:32.152454 14135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:32.152706 14124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:32.153012 14124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:32.154187 14124 hybrid_clock.cc:648] HybridClock initialized: now 1786553072154173 us; error 39 us; skew 500 ppm
Aug 12 16:44:32 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553072, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:32.157019 14124 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:44:32.157557 14124 webserver.cc:460] Webserver started at http://127.21.114.67:45401/ using document root <none> and password file <none>
I20260812 16:44:32.157850 14124 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:32.157907 14124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 16:44:32 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553072, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:32.180892 14124 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.001s
I20260812 16:44:32.182060 14150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:32.182269 14124 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:44:32.182394 14124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "00eae60325724711bbea14e325bb1c1c"
format_stamp: "Formatted at 2026-08-12 16:44:31 on dist-test-slave-45dx"
server_key: "8955525b05e4a5d0aa2b5fecf252c4ef"
server_key_iv: "dfbd9409c5b7a367bf21eacba9e94a07"
server_key_version: "kuduclusterkey@0"
I20260812 16:44:32.182899 14124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:32.206307 14124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:32.208477 14124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:32.208643 14124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:32.209007 14124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:32.209422 14124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:32.209488 14124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:32.209532 14124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:32.209559 14124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:32.216938 14124 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:40937
I20260812 16:44:32.217069 14336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:40937 every 8 connection(s)
I20260812 16:44:32.217387 14124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:44:32 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553072, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:32.227371 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 14124
I20260812 16:44:32.229615 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:32.218294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:48661 (local address 127.21.114.126:34175)
0812 16:44:32.218348 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:32.218350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:32.219518 (+ 1168us) server_negotiation.cc:407] Connection header received
0812 16:44:32.220054 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:32.220055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:32.220069 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:32.220123 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:32.220902 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.221411 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.222436 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.222657 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.222734 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:32.225273 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:32.225275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:32.225275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:32.225284 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:32.227117 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:32.228523 (+ 1406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:32.228525 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:32.228525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:32.228587 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:32.228861 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:32.228862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:32.228862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:32.229001 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:32.229054 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:32.229432 (+ 378us) server_negotiation.cc:299] Negotiation successful
0812 16:44:32.229525 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:44:32.230036 14341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:32.218298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:34175 (local address 127.21.114.67:48661)
0812 16:44:32.219360 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:32.219412 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:32.219944 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:32.220223 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:32.220228 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:32.220487 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:32.220751 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:32.220757 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.221511 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.221512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:32.222332 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:32.222334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.222778 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.222780 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:32.222900 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:32.223516 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:32.223528 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:32.225156 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:32.228058 (+ 2902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:32.228065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:32.228067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:32.228430 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:32.228658 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:32.228658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:32.228659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:32.228784 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:32.229089 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:32.229096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:32.229266 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 16:44:32.229397 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 16:44:32.229555 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"thread_start_us":95,"threads_started":1}
I20260812 16:44:32.230559 14339 heartbeater.cc:347] Connected to a master server at 127.21.114.126:34175
I20260812 16:44:32.230675 14339 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.230885 14339 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
W20260812 16:44:32.231496 14339 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:34175 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 16:44:32.231578 14339 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.231649 14339 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:32.232091 14339 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.232183 14339 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
W20260812 16:44:32.232654 14339 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 16:44:32.238015 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:32.227967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43834 (local address 127.21.114.126:34175)
0812 16:44:32.229701 (+ 1734us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:32.229703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:32.231306 (+ 1603us) server_negotiation.cc:407] Connection header received
0812 16:44:32.231325 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:32.231326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:32.231335 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:32.231376 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:32.232551 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.233123 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.233903 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:32.234106 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:32.234191 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:32.235437 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:32.235438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:32.235438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:32.235445 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:32.236816 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:32.237186 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:32.237188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:32.237188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:32.237243 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:32.237451 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:32.237452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:32.237453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:32.237557 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:32.237759 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:32.237796 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 16:44:32.237873 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1717,"thread_start_us":53,"threads_started":1}
Aug 12 16:44:32 dist-test-slave-45dx krb5kdc[11747](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786553072, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:32.821282 13879 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:32.821494 13879 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:32.821918 13509 ts_manager.cc:194] Registered new tserver with Master: 91ab989b04ab4bd184ba43fd02516ad0 (127.21.114.65:35269)
I20260812 16:44:32.822981 13509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:55831
I20260812 16:44:33.041363 14120 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:33.041555 14120 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:33.041944 13509 ts_manager.cc:194] Registered new tserver with Master: b1200b4579b84b7fbb63879ee5cd6075 (127.21.114.66:45771)
I20260812 16:44:33.042536 13509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:50901
Aug 12 16:44:33 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553072, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:33.232831 14339 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:33.232998 14339 heartbeater.cc:511] Master 127.21.114.126:34175 requested a full tablet report, sending...
I20260812 16:44:33.233336 13509 ts_manager.cc:194] Registered new tserver with Master: 00eae60325724711bbea14e325bb1c1c (127.21.114.67:40937)
I20260812 16:44:33.233877 13509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:48661
I20260812 16:44:33.240880 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:44:33.256350 14372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.241913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43842 (local address 127.21.114.126:34175)
0812 16:44:33.242576 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.242578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.242762 (+ 184us) server_negotiation.cc:407] Connection header received
0812 16:44:33.242786 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.242787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.242798 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.242856 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:33.243575 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.244397 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.245465 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.245787 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.245851 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.253156 (+ 7305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:33.253157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:33.253158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:33.253166 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:33.254928 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:33.255275 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:33.255276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:33.255277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:33.255327 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:33.255495 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:33.255495 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:33.255496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:33.255636 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:33.255721 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.256144 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.256224 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":74,"threads_started":1}
I20260812 16:44:33.258834 13509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:44:33.261593 13509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:44:33.280395 14388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.264656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:40937 (local address 127.0.0.1:35934)
0812 16:44:33.269729 (+ 5073us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:33.269740 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:33.269790 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:33.270101 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:33.270104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:33.270106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:33.270188 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.270190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.271491 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.271492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.273505 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.273509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.280053 (+ 6544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.280054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.280148 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.280164 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 16:44:33.280230 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 16:44:33.280281 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5054,"thread_start_us":84,"threads_started":1}
I20260812 16:44:33.280678 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.264915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.21.114.67:40937)
0812 16:44:33.268525 (+ 3610us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.268528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.269852 (+ 1324us) server_negotiation.cc:407] Connection header received
0812 16:44:33.269896 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.269898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.269916 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.269987 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:33.270266 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.271373 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.273615 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.274423 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.278402 (+ 3979us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.278466 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.280551 (+ 2085us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.280603 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3577,"thread_start_us":71,"threads_started":1}
I20260812 16:44:33.281010 14386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.264871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:45771 (local address 127.0.0.1:33768)
0812 16:44:33.272522 (+ 7651us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:33.272532 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:33.272582 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:33.274535 (+ 1953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:33.274537 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:33.274539 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:33.274580 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.274581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.276197 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.276197 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.277345 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.277349 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.280788 (+ 3439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.280789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.280852 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.280855 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:44:33.280908 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 16:44:33.280945 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7634,"thread_start_us":58,"threads_started":1}
I20260812 16:44:33.281301 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.264967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.21.114.66:45771)
0812 16:44:33.268446 (+ 3479us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.268451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.272644 (+ 4193us) server_negotiation.cc:407] Connection header received
0812 16:44:33.272684 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.272686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.272704 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.272772 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:33.274655 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.276105 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.277464 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.278224 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.278304 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.278364 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.281178 (+ 2814us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.281228 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3440,"thread_start_us":48,"threads_started":1}
I20260812 16:44:33.281435 14232 tablet_service.cc:1467] Processing CreateTablet for tablet f3d8be7f4fcb4002bf89fb5bdcda273a (DEFAULT_TABLE table=test-table [id=9d865763dade4517bc5a4f17077ae1ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:33.281884 14232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3d8be7f4fcb4002bf89fb5bdcda273a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:33.283877 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.264641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:35269 (local address 127.0.0.1:51604)
0812 16:44:33.268593 (+ 3952us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:33.268638 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:33.268707 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:33.278783 (+ 10076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:33.278784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:33.278786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:33.278831 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.278832 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.281646 (+ 2814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.281647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.282692 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.282694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.283675 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.283676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.283732 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.283735 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:44:33.283778 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 16:44:33.283813 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3922,"thread_start_us":74,"threads_started":1}
I20260812 16:44:33.284209 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.265057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.21.114.65:35269)
0812 16:44:33.278566 (+ 13509us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.278571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.278581 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:44:33.278614 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.278616 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.278632 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.278705 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:33.278898 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.281554 (+ 2656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.282804 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.283513 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.283586 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.283640 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.284089 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.284133 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13469,"thread_start_us":64,"threads_started":1}
I20260812 16:44:33.284880 13754 tablet_service.cc:1467] Processing CreateTablet for tablet f3d8be7f4fcb4002bf89fb5bdcda273a (DEFAULT_TABLE table=test-table [id=9d865763dade4517bc5a4f17077ae1ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:33.285246 13754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3d8be7f4fcb4002bf89fb5bdcda273a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:33.285952 14002 tablet_service.cc:1467] Processing CreateTablet for tablet f3d8be7f4fcb4002bf89fb5bdcda273a (DEFAULT_TABLE table=test-table [id=9d865763dade4517bc5a4f17077ae1ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:33.286258 14002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3d8be7f4fcb4002bf89fb5bdcda273a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:33.289951 14399 tablet_bootstrap.cc:492] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Bootstrap starting.
I20260812 16:44:33.290581 14399 tablet_bootstrap.cc:654] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:33.290901 14399 log.cc:824] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:33.291667 14399 tablet_bootstrap.cc:492] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: No bootstrap required, opened a new log
I20260812 16:44:33.291733 14399 ts_tablet_manager.cc:1397] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:44:33.293804 14399 raft_consensus.cc:348] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.293980 14399 raft_consensus.cc:374] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:33.294023 14399 raft_consensus.cc:729] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1200b4579b84b7fbb63879ee5cd6075, State: Initialized, Role: FOLLOWER
I20260812 16:44:33.294128 14399 consensus_queue.cc:260] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.294399 14399 ts_tablet_manager.cc:1428] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:44:33.294526 14120 heartbeater.cc:503] Master 127.21.114.126:34175 was elected leader, sending a full tablet report...
I20260812 16:44:33.296501 14396 tablet_bootstrap.cc:492] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0: Bootstrap starting.
I20260812 16:44:33.297200 14396 tablet_bootstrap.cc:654] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:33.297646 14396 log.cc:824] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:33.299101 14396 tablet_bootstrap.cc:492] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0: No bootstrap required, opened a new log
I20260812 16:44:33.299216 14396 ts_tablet_manager.cc:1397] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:44:33.300475 14395 tablet_bootstrap.cc:492] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Bootstrap starting.
I20260812 16:44:33.301106 14395 tablet_bootstrap.cc:654] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:33.301400 14395 log.cc:824] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:33.301744 14396 raft_consensus.cc:348] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.301963 14396 raft_consensus.cc:374] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:33.302040 14396 raft_consensus.cc:729] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ab989b04ab4bd184ba43fd02516ad0, State: Initialized, Role: FOLLOWER
I20260812 16:44:33.302286 14396 consensus_queue.cc:260] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.302930 14396 ts_tablet_manager.cc:1428] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 16:44:33.303089 13879 heartbeater.cc:503] Master 127.21.114.126:34175 was elected leader, sending a full tablet report...
I20260812 16:44:33.304937 14395 tablet_bootstrap.cc:492] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: No bootstrap required, opened a new log
I20260812 16:44:33.305006 14395 ts_tablet_manager.cc:1397] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 16:44:33.307659 14395 raft_consensus.cc:348] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.307816 14395 raft_consensus.cc:374] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:33.307848 14395 raft_consensus.cc:729] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00eae60325724711bbea14e325bb1c1c, State: Initialized, Role: FOLLOWER
I20260812 16:44:33.308072 14395 consensus_queue.cc:260] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.308425 14395 ts_tablet_manager.cc:1428] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:44:33.308583 14339 heartbeater.cc:503] Master 127.21.114.126:34175 was elected leader, sending a full tablet report...
I20260812 16:44:33.365473 14405 raft_consensus.cc:482] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:44:33.365630 14405 raft_consensus.cc:504] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.366050 14405 leader_election.cc:288] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00eae60325724711bbea14e325bb1c1c (127.21.114.67:40937), b1200b4579b84b7fbb63879ee5cd6075 (127.21.114.66:45771)
I20260812 16:44:33.379464 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.366851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:55683 (local address 127.21.114.67:40937)
0812 16:44:33.366891 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.366894 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.367093 (+ 199us) server_negotiation.cc:407] Connection header received
0812 16:44:33.367188 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.367189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.367198 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.367225 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:33.368550 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.369218 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.378297 (+ 9079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.378887 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.378936 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.378943 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.379333 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.379384 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:44:33.379949 14408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.366671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:40937 (local address 127.21.114.65:55683)
0812 16:44:33.367053 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:33.367060 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:33.367119 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:33.367332 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:33.367332 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:33.367334 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:33.367420 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.367422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.373536 (+ 6114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.373537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.377498 (+ 3961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.377501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.379183 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.379184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.379249 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.379251 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:44:33.379806 (+ 555us) client_negotiation.cc:240] Negotiation successful
0812 16:44:33.379854 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":73,"threads_started":1}
I20260812 16:44:33.380291 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.366519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:48335 (local address 127.21.114.66:45771)
0812 16:44:33.366563 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.366566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.367017 (+ 451us) server_negotiation.cc:407] Connection header received
0812 16:44:33.367498 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.367499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.367508 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.367535 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:33.367704 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.368446 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.377603 (+ 9157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.378175 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.378225 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.378234 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.380172 (+ 1938us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.380228 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:44:33.381023 14239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d8be7f4fcb4002bf89fb5bdcda273a" candidate_uuid: "91ab989b04ab4bd184ba43fd02516ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00eae60325724711bbea14e325bb1c1c" is_pre_election: true
I20260812 16:44:33.381196 14239 raft_consensus.cc:2454] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91ab989b04ab4bd184ba43fd02516ad0 in term 0.
I20260812 16:44:33.381520 13671 leader_election.cc:302] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00eae60325724711bbea14e325bb1c1c, 91ab989b04ab4bd184ba43fd02516ad0; no voters:
I20260812 16:44:33.381652 14405 raft_consensus.cc:2781] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:44:33.381690 14405 raft_consensus.cc:482] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:44:33.381711 14405 raft_consensus.cc:3037] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:33.382699 14405 raft_consensus.cc:504] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.382835 14405 leader_election.cc:288] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [CANDIDATE]: Term 1 election: Requested vote from peers 00eae60325724711bbea14e325bb1c1c (127.21.114.67:40937), b1200b4579b84b7fbb63879ee5cd6075 (127.21.114.66:45771)
I20260812 16:44:33.383240 14239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d8be7f4fcb4002bf89fb5bdcda273a" candidate_uuid: "91ab989b04ab4bd184ba43fd02516ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00eae60325724711bbea14e325bb1c1c"
I20260812 16:44:33.383314 14239 raft_consensus.cc:3037] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:33.384155 14239 raft_consensus.cc:2454] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91ab989b04ab4bd184ba43fd02516ad0 in term 1.
I20260812 16:44:33.384402 13671 leader_election.cc:302] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00eae60325724711bbea14e325bb1c1c, 91ab989b04ab4bd184ba43fd02516ad0; no voters:
I20260812 16:44:33.384516 14405 raft_consensus.cc:2781] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:33.384665 14405 raft_consensus.cc:686] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [term 1 LEADER]: Becoming Leader. State: Replica: 91ab989b04ab4bd184ba43fd02516ad0, State: Running, Role: LEADER
I20260812 16:44:33.384748 14405 consensus_queue.cc:237] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } }
I20260812 16:44:33.385629 13507 catalog_manager.cc:5495] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91ab989b04ab4bd184ba43fd02516ad0 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "91ab989b04ab4bd184ba43fd02516ad0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ab989b04ab4bd184ba43fd02516ad0" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 35269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 } health_report { overall_health: UNKNOWN } } }
I20260812 16:44:33.380681 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.366277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:45771 (local address 127.21.114.65:48335)
0812 16:44:33.366952 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:33.366963 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:33.367263 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:33.367588 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:33.367589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:33.367590 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:33.367643 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.367644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.373737 (+ 6093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.373738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.377049 (+ 3311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:33.377053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.379031 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.379031 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:33.379101 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.379105 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:44:33.380561 (+ 1456us) client_negotiation.cc:240] Negotiation successful
0812 16:44:33.380601 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":1108,"thread_start_us":118,"threads_started":1}
I20260812 16:44:33.387077 14025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d8be7f4fcb4002bf89fb5bdcda273a" candidate_uuid: "91ab989b04ab4bd184ba43fd02516ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1200b4579b84b7fbb63879ee5cd6075" is_pre_election: true
I20260812 16:44:33.387219 14025 raft_consensus.cc:2454] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91ab989b04ab4bd184ba43fd02516ad0 in term 0.
I20260812 16:44:33.387336 14024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3d8be7f4fcb4002bf89fb5bdcda273a" candidate_uuid: "91ab989b04ab4bd184ba43fd02516ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1200b4579b84b7fbb63879ee5cd6075"
I20260812 16:44:33.387382 14024 raft_consensus.cc:3037] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:33.388149 14024 raft_consensus.cc:2454] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91ab989b04ab4bd184ba43fd02516ad0 in term 1.
I20260812 16:44:33.419308 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.414144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51616 (local address 127.21.114.65:35269)
0812 16:44:33.414189 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:33.414192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:33.415554 (+ 1362us) server_negotiation.cc:407] Connection header received
0812 16:44:33.415604 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:33.415605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:33.415632 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:33.415705 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:44:33.415900 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.416872 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.418231 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:33.418506 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:33.418562 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:33.418747 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:44:33.418897 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:44:33.418976 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:33.419209 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 16:44:33.419231 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:44:33.421645 14024 raft_consensus.cc:1261] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 1 FOLLOWER]: Refusing update from remote peer 91ab989b04ab4bd184ba43fd02516ad0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:33.422057 14239 raft_consensus.cc:1261] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 1 FOLLOWER]: Refusing update from remote peer 91ab989b04ab4bd184ba43fd02516ad0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:33.422257 14405 consensus_queue.cc:1035] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1200b4579b84b7fbb63879ee5cd6075" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:33.422642 14405 consensus_queue.cc:1035] T f3d8be7f4fcb4002bf89fb5bdcda273a P 91ab989b04ab4bd184ba43fd02516ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00eae60325724711bbea14e325bb1c1c" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 40937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 12 16:44:33 dist-test-slave-45dx krb5kdc[11747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553072, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for HTTP/127.21.114.84@KRBTEST.COM
I20260812 16:44:33.426414 14416 mvcc.cc:205] Tried to move back new op lower bound from 7317721388731023360 to 7317721388584521728. Current Snapshot: MvccSnapshot[applied={T|T < 7317721388731023360}]
I20260812 16:44:33.427893 14422 mvcc.cc:205] Tried to move back new op lower bound from 7317721388731023360 to 7317721388584521728. Current Snapshot: MvccSnapshot[applied={T|T < 7317721388731023360}]
I20260812 16:44:33.430635 13509 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:44:33.430740 13509 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:44:33.431632 13509 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0bed88e17704ca58cad4f52f2bd3e56: Sending DeleteTablet for 3 replicas of tablet f3d8be7f4fcb4002bf89fb5bdcda273a
I20260812 16:44:33.432175 13754 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d8be7f4fcb4002bf89fb5bdcda273a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:33 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:51604
I20260812 16:44:33.432456 14232 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d8be7f4fcb4002bf89fb5bdcda273a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:33 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:35934
I20260812 16:44:33.432884 14002 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d8be7f4fcb4002bf89fb5bdcda273a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:33 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:33768
I20260812 16:44:33.432997 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 13574
I20260812 16:44:33.433619 14439 tablet_replica.cc:330] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: stopping tablet replica
I20260812 16:44:33.433723 14439 raft_consensus.cc:2229] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:44:33.433785 14439 raft_consensus.cc:2258] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:33.440444 14438 tablet_replica.cc:330] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: stopping tablet replica
I20260812 16:44:33.440611 14438 raft_consensus.cc:2229] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:44:33.440793 14438 raft_consensus.cc:2258] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:33.441596 14439 ts_tablet_manager.cc:1905] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:44:33.443553 14439 ts_tablet_manager.cc:1918] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:44:33.443647 14439 log.cc:1196] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/f3d8be7f4fcb4002bf89fb5bdcda273a
I20260812 16:44:33.443969 14439 ts_tablet_manager.cc:1939] T f3d8be7f4fcb4002bf89fb5bdcda273a P b1200b4579b84b7fbb63879ee5cd6075: Deleting consensus metadata
I20260812 16:44:33.444588 13480 catalog_manager.cc:4841] TS b1200b4579b84b7fbb63879ee5cd6075 (127.21.114.66:45771): tablet f3d8be7f4fcb4002bf89fb5bdcda273a (table test-table [id=9d865763dade4517bc5a4f17077ae1ea]) successfully deleted
I20260812 16:44:33.444849 14438 ts_tablet_manager.cc:1905] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:44:33.446640 14438 ts_tablet_manager.cc:1918] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:44:33.446720 14438 log.cc:1196] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/f3d8be7f4fcb4002bf89fb5bdcda273a
I20260812 16:44:33.447016 14438 ts_tablet_manager.cc:1939] T f3d8be7f4fcb4002bf89fb5bdcda273a P 00eae60325724711bbea14e325bb1c1c: Deleting consensus metadata
I20260812 16:44:33.447540 13483 catalog_manager.cc:4841] TS 00eae60325724711bbea14e325bb1c1c (127.21.114.67:40937): tablet f3d8be7f4fcb4002bf89fb5bdcda273a (table test-table [id=9d865763dade4517bc5a4f17077ae1ea]) successfully deleted
W20260812 16:44:33.451956 13480 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:35269 (error 108)
I20260812 16:44:33.452330 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 13884
I20260812 16:44:33.492821 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:33.492643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:35269 (local address 127.0.0.1:51618)
0812 16:44:33.492708 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:33.492762 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:35269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 16:44:33.493132 13480 catalog_manager.cc:4584] TS 91ab989b04ab4bd184ba43fd02516ad0 (127.21.114.65:35269): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f3d8be7f4fcb4002bf89fb5bdcda273a: Network error: Client connection negotiation failed: client connection to 127.21.114.65:35269: connect: Connection refused (error 111)
I20260812 16:44:33.498027 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 14124
I20260812 16:44:33.513015 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 13456
I20260812 16:44:33.525131 21961 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 16:44:33.870800 21961 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 16:44:33.870906 21961 mini_ranger.cc:66] Stopping Ranger...
I20260812 16:44:34.225694 21961 mini_ranger.cc:68] Stopped Ranger
2026-08-12 16:44:34.225 UTC [11798] LOG: received smart shutdown request
2026-08-12 16:44:34.230 UTC [11798] LOG: background worker "logical replication launcher" (PID 11819) exited with exit code 1
2026-08-12 16:44:34.230 UTC [11807] LOG: shutting down
2026-08-12 16:44:34.393 UTC [11798] LOG: database system is shut down
2026-08-12T16:44:34Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50127 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:44:34 dist-test-slave-45dx krb5kdc[14460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:44:34 dist-test-slave-45dx krb5kdc[14460](info): set up 2 sockets
Aug 12 16:44:34 dist-test-slave-45dx krb5kdc[14460](info): commencing operation
krb5kdc: starting...
W20260812 16:44:35.840543 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:44:35 dist-test-slave-45dx krb5kdc[14460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:44:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:44:35.964654 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42217
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42217,127.21.114.125:41287,127.21.114.124:40303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:36.054345 14486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:36.054544 14486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:36.054565 14486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:36.055629 14486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:36.055660 14486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:36.055675 14486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:36.055687 14486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:36.055699 14486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:36.057209 14486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42217,127.21.114.125:41287,127.21.114.124:40303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:36.057408 14486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:36.057585 14486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:36.062553 14496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:36.062738 14486 server_base.cc:1034] running on GCE node
W20260812 16:44:36.062553 14497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:36.062619 14500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:36.063161 14486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:36.063496 14486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:36.064669 14486 hybrid_clock.cc:648] HybridClock initialized: now 1786553076064656 us; error 27 us; skew 500 ppm
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:36.067202 14486 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:36.067634 14486 webserver.cc:460] Webserver started at http://127.21.114.126:41857/ using document root <none> and password file <none>
I20260812 16:44:36.067865 14486 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:36.067943 14486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:36.068100 14486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:36.069249 14486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "5ed9558de91b4833a77495cf9a13d9b1"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "771b6596c6abfb1d36053e3123a4a610"
server_key_iv: "eae460d1e60dfbda0005c557e3d53485"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.069689 14486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "5ed9558de91b4833a77495cf9a13d9b1"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "771b6596c6abfb1d36053e3123a4a610"
server_key_iv: "eae460d1e60dfbda0005c557e3d53485"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.071079 14486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:44:36.071827 14510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:36.072018 14486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:36.072124 14486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "5ed9558de91b4833a77495cf9a13d9b1"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "771b6596c6abfb1d36053e3123a4a610"
server_key_iv: "eae460d1e60dfbda0005c557e3d53485"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.072209 14486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:36.085510 14486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:36.087363 14486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:36.087535 14486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:36.091840 14486 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:42217
I20260812 16:44:36.091903 14599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:42217 every 8 connection(s)
I20260812 16:44:36.092298 14486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:36.093266 14601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:36.094990 14601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:44:36.099931 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 14486
I20260812 16:44:36.100059 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:44:36.100281 21961 external_mini_cluster.cc:1428] Setting key 5d314fbcec81d1371c2f141b098e8c3a
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:36.105594 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.095736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42217 (local address 127.0.0.1:40050)
0812 16:44:36.095910 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.095948 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.096543 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.096852 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.096854 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.097142 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.097299 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.097304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.098341 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.098342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.099046 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.099048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.099582 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.099584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.099651 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.100352 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.100365 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.101920 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.103982 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.103989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.103991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.104189 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.104505 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.104506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.104506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.104594 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.105087 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.105092 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.105190 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.105286 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.105421 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260812 16:44:36.105654 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.095911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40050 (local address 127.21.114.126:42217)
0812 16:44:36.096027 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.096032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.096067 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:44:36.096712 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.096719 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.096737 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.096837 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.097405 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.098228 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.099150 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.099483 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.099613 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.102033 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.102043 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.102043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.102053 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.103878 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.104270 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.104273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.104274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.104433 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.104661 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.104661 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.104662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.105013 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.105106 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.105355 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.105513 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":87,"thread_start_us":43,"threads_started":1}
I20260812 16:44:36.106463 14601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:44:36.106818 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.106701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55734)
0812 16:44:36.106750 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.106799 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 16:44:36.106982 14515 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
I20260812 16:44:36.107407 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.107310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55736)
0812 16:44:36.107358 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.107382 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 16:44:36.107506 14601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:41287: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.21.114.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab.
Entry for principal kudu/127.21.114.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab.
I20260812 16:44:36.128548 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:41287
--webserver_interface=127.21.114.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab
--principal=kudu/127.21.114.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42217,127.21.114.125:41287,127.21.114.124:40303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:36.156719 14601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } attempt: 1
I20260812 16:44:36.157214 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.157074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55752)
0812 16:44:36.157138 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.157172 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 16:44:36.157549 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.157452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55766)
0812 16:44:36.157498 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.157522 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 16:44:36.157645 14601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:41287: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
W20260812 16:44:36.213055 14613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:36.213264 14613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:36.213285 14613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:36.214423 14613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:36.214464 14613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:36.214479 14613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:36.214521 14613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:36.214550 14613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:36.215999 14613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42217,127.21.114.125:41287,127.21.114.124:40303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab
--principal=kudu/127.21.114.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:41287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.114.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:36.216249 14613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:36.216495 14613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:36.221190 14622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:36.221194 14624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:36.221287 14619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:36.221482 14613 server_base.cc:1034] running on GCE node
I20260812 16:44:36.221760 14613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:36.222074 14613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:36.223225 14613 hybrid_clock.cc:648] HybridClock initialized: now 1786553076223207 us; error 39 us; skew 500 ppm
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:36.225806 14613 init.cc:377] Logged in from keytab as kudu/127.21.114.125@KRBTEST.COM (short username kudu)
I20260812 16:44:36.225777 14601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } attempt: 2
I20260812 16:44:36.226195 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.226039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55774)
0812 16:44:36.226118 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.226157 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 16:44:36.226358 14613 webserver.cc:460] Webserver started at http://127.21.114.125:44305/ using document root <none> and password file <none>
I20260812 16:44:36.226624 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.226521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55784)
0812 16:44:36.226570 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.226599 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 16:44:36.226775 14601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:41287: Network error: Client connection negotiation failed: client connection to 127.21.114.125:41287: connect: Connection refused (error 111)
I20260812 16:44:36.226811 14613 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:36.226902 14613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:36.227047 14613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:36.228152 14613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data/instance:
uuid: "82401e5d6a4946328ea24ed15960eb4c"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "5f92abc2314706a456d263fa51057cbc"
server_key_iv: "b8bd42a973d95bbb331f774a8012f9c6"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.228561 14613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal/instance:
uuid: "82401e5d6a4946328ea24ed15960eb4c"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "5f92abc2314706a456d263fa51057cbc"
server_key_iv: "b8bd42a973d95bbb331f774a8012f9c6"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.229905 14613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:36.230649 14631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:36.230824 14613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:36.230928 14613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal
uuid: "82401e5d6a4946328ea24ed15960eb4c"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "5f92abc2314706a456d263fa51057cbc"
server_key_iv: "b8bd42a973d95bbb331f774a8012f9c6"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.231012 14613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:36.239699 14613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:36.241552 14613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:36.241712 14613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:36.245705 14613 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.125:41287
I20260812 16:44:36.245754 14722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.125:41287 every 8 connection(s)
I20260812 16:44:36.246120 14613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
I20260812 16:44:36.247008 14727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:36.248696 14727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:36.254530 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 14613
I20260812 16:44:36.254629 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-1/wal/instance
I20260812 16:44:36.254861 21961 external_mini_cluster.cc:1428] Setting key 75b881e81b6d2c8e7cf849d07b2f5696
I20260812 16:44:36.257864 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.249442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40054 (local address 127.21.114.126:42217)
0812 16:44:36.249523 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.249526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.249716 (+ 190us) server_negotiation.cc:407] Connection header received
0812 16:44:36.250222 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.250223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.250239 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.250292 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.250901 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.251379 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.252425 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.252629 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.252714 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.254954 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.254956 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.254956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.254965 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.256421 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.256900 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.256902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.256902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.256973 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.257210 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.257211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.257211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.257358 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.257429 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.257662 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.257758 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:44:36.257892 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.249400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42217 (local address 127.0.0.1:40054)
0812 16:44:36.249599 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.249633 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.250104 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.250364 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.250367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.250615 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.250801 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.250805 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.251481 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.251482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.252280 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.252282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.252727 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.252728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.252858 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.253363 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.253372 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.254848 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.256499 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.256507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.256509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.256813 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.257046 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.257047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.257047 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.257149 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.257423 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.257428 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.257539 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.257620 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.257735 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":83,"threads_started":1}
I20260812 16:44:36.258406 14727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.114.124@KRBTEST.COM; defaulting to no policy
I20260812 16:44:36.267339 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.258683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55794)
0812 16:44:36.258757 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.258767 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.258811 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.259059 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.259060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.259220 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.259280 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.259282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.260090 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.260092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.260979 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.260983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.261644 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.261646 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.261795 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.262241 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.262261 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.263803 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.266095 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.266097 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.266097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.266324 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.266552 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.266553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.266553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.266647 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.266972 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.266972 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.267031 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.267106 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.267215 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 16:44:36.267767 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.258771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55794 (local address 127.21.114.125:41287)
0812 16:44:36.258912 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.258917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.258936 (+ 19us) server_negotiation.cc:407] Connection header received
0812 16:44:36.258964 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.258965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.258976 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.259035 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.259353 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.260004 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.261084 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.261566 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.261646 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.263923 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.263931 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.263932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.263939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.266008 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.266396 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.266413 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.266414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.266476 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.266725 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.266726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.266727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.266912 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.266990 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.267155 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.267317 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260812 16:44:36.268343 14727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:44:36.272421 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.272182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44462)
0812 16:44:36.272329 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.272386 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260812 16:44:36.272658 14641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
I20260812 16:44:36.273115 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.273018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44466)
0812 16:44:36.273059 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.273090 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 16:44:36.273244 14727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40303: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab.
Entry for principal kudu/127.21.114.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab.
I20260812 16:44:36.290855 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:40303
--webserver_interface=127.21.114.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab
--principal=kudu/127.21.114.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:43735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42217,127.21.114.125:41287,127.21.114.124:40303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:36.317936 14601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } attempt: 3
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:44:36.322456 14727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } attempt: 1
I20260812 16:44:36.322850 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.322722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44476)
0812 16:44:36.322782 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.322819 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 16:44:36.323256 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.323153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44480)
0812 16:44:36.323200 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.323227 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 16:44:36.323449 14727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40303: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
I20260812 16:44:36.325654 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.318380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55810 (local address 127.21.114.125:41287)
0812 16:44:36.318452 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.318454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.318484 (+ 30us) server_negotiation.cc:407] Connection header received
0812 16:44:36.318513 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.318514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.318533 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.318595 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.318937 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.319469 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.320180 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.320460 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.320546 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.322762 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.322764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.322764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.322773 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.324480 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.324841 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.324843 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.324844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.324914 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.325119 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.325120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.325121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.325243 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.325317 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.325494 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.325571 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:44:36.325656 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.318282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55810)
0812 16:44:36.318357 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.318376 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.318446 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.318604 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.318605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.318771 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.318840 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.318842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.319573 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.319575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.320095 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.320097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.320546 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.320547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.320641 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.321168 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.321173 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.322613 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.324561 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.324561 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.324562 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.324747 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.324982 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.324983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.324984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.325052 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.325323 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.325323 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.325371 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.325456 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.325561 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 16:44:36.326037 14601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:44:36.326409 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.326275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44486)
0812 16:44:36.326336 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.326376 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 16:44:36.326751 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.326650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44488)
0812 16:44:36.326698 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.326732 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 16:44:36.326853 14601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40303: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
I20260812 16:44:36.358007 14601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } attempt: 1
I20260812 16:44:36.358546 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.358361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44492)
0812 16:44:36.358438 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.358496 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 16:44:36.358976 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.358868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44500)
0812 16:44:36.358915 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.358946 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 16:44:36.359094 14601 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40303: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
W20260812 16:44:36.378158 14735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:36.378360 14735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:36.378381 14735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:36.379514 14735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:36.379558 14735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:36.379572 14735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:36.379623 14735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:36.379642 14735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:36.381217 14735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:43735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42217,127.21.114.125:41287,127.21.114.124:40303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab
--principal=kudu/127.21.114.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:40303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.114.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:36.381484 14735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:36.381721 14735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:36.386554 14747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:36.386569 14744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:36.386552 14743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:36.386823 14735 server_base.cc:1034] running on GCE node
I20260812 16:44:36.387084 14735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:36.387373 14735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:36.388520 14735 hybrid_clock.cc:648] HybridClock initialized: now 1786553076388507 us; error 28 us; skew 500 ppm
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:36.390972 14735 init.cc:377] Logged in from keytab as kudu/127.21.114.124@KRBTEST.COM (short username kudu)
I20260812 16:44:36.391379 14735 webserver.cc:460] Webserver started at http://127.21.114.124:42791/ using document root <none> and password file <none>
I20260812 16:44:36.391636 14735 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:36.391592 14727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } attempt: 2
I20260812 16:44:36.391706 14735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:36.391844 14735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:36.392079 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.391972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44516)
0812 16:44:36.392017 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.392051 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 16:44:36.392419 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.392326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44520)
0812 16:44:36.392356 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.392403 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 16:44:36.392506 14727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40303: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40303: connect: Connection refused (error 111)
I20260812 16:44:36.393078 14735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data/instance:
uuid: "18f10befbe964d919e441fd41ac439c7"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "992a51aa295f3d4549530385ef53bd9f"
server_key_iv: "7c7877d4c9106097c1729fab56131502"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.393448 14735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal/instance:
uuid: "18f10befbe964d919e441fd41ac439c7"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "992a51aa295f3d4549530385ef53bd9f"
server_key_iv: "7c7877d4c9106097c1729fab56131502"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.394783 14735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:44:36.395524 14759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:36.395709 14735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:36.395804 14735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal
uuid: "18f10befbe964d919e441fd41ac439c7"
format_stamp: "Formatted at 2026-08-12 16:44:36 on dist-test-slave-45dx"
server_key: "992a51aa295f3d4549530385ef53bd9f"
server_key_iv: "7c7877d4c9106097c1729fab56131502"
server_key_version: "encryptionkey@0"
I20260812 16:44:36.395887 14735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:36.416277 14735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:36.418305 14735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:36.418484 14735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:36.422821 14735 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.124:40303
I20260812 16:44:36.422878 14841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.124:40303 every 8 connection(s)
I20260812 16:44:36.423251 14735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
I20260812 16:44:36.424189 14844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:36.425778 14844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:44:36.426254 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 14735
I20260812 16:44:36.426390 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786552916613187-21961-0/minicluster-data/master-2/wal/instance
I20260812 16:44:36.426610 21961 external_mini_cluster.cc:1428] Setting key b3007b800375176f637929afc57997b5
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:44:36.434242 14601 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } attempt: 2
I20260812 16:44:36.435731 14847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.426570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42217 (local address 127.0.0.1:40064)
0812 16:44:36.426756 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.426798 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.427356 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.427566 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.427568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.427837 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.427994 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.427998 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.428728 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.428729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.429441 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.429443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.429814 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.429815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.429949 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.430467 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.430478 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.431946 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.433982 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.433989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.433991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.434229 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.434499 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.434500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.434500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.434659 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.435052 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.435060 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.435231 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.435341 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.435502 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":114,"threads_started":1}
I20260812 16:44:36.436168 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.426571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.21.114.126:42217)
0812 16:44:36.426644 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.426647 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.426873 (+ 226us) server_negotiation.cc:407] Connection header received
0812 16:44:36.427480 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.427481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.427494 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.427549 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.428091 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.428645 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.429532 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.429728 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.429808 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.432044 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.432046 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.432046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.432053 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.433891 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.434330 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.434332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.434332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.434422 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.434773 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.434774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.434774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.434922 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.435041 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.435995 (+ 954us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.436084 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:44:36.436209 14850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.427023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44534 (local address 127.21.114.124:40303)
0812 16:44:36.427338 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.427342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.427369 (+ 27us) server_negotiation.cc:407] Connection header received
0812 16:44:36.427436 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.427442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.427460 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.427553 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.428190 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.429032 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.429758 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.430061 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.430140 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.432668 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.432676 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.432676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.432684 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.434763 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.435196 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.435199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.435200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.435267 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.435479 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.435480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.435480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.435620 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.435858 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.435902 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.435980 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":71,"threads_started":1}
I20260812 16:44:36.436586 14844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:36.443847 14605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.434489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44540)
0812 16:44:36.434585 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.434596 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.434636 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.434978 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.434979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.435135 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.435190 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.435191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.436056 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.436057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.436828 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.436831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.437326 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.437328 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.437384 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.437817 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.437821 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.439333 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.441956 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.441957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.441957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.442162 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.443153 (+ 991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.443154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.443154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.443236 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.443502 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.443503 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.443546 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.443621 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.443746 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 16:44:36.443872 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.434616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44540 (local address 127.21.114.124:40303)
0812 16:44:36.434845 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.434847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.434853 (+ 6us) server_negotiation.cc:407] Connection header received
0812 16:44:36.434872 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.434873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.434884 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.434956 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.435256 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.435962 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.436935 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.437238 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.437717 (+ 479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.439439 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.439441 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.439441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.439449 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.441843 (+ 2394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.442236 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.442237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.442237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.442328 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.443305 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.443306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.443307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.443423 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.443497 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.443663 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.443743 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
I20260812 16:44:36.444830 14847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.436796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:41287 (local address 127.0.0.1:55826)
0812 16:44:36.437007 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.437017 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.437049 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.437212 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.437213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.437367 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.437433 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.437435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.438248 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.438249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.438778 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.438780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.439309 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.439310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.439393 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.439784 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.439789 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.441168 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.443106 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.443107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.443108 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.443640 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.443871 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.443872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.443872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.444132 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.444514 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.444515 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.444556 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.444619 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.444709 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197}
I20260812 16:44:36.445104 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.436966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55826 (local address 127.21.114.125:41287)
0812 16:44:36.437026 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.437028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.437042 (+ 14us) server_negotiation.cc:407] Connection header received
0812 16:44:36.437118 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.437119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.437129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.437171 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.437502 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.438166 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.438871 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.439154 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.439213 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.441273 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.441274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.441275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.441282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.443030 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.443733 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.443734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.443735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.443795 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.444229 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.444231 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.444231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.444413 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.444483 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.444947 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.445020 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:44:36.445501 14844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:44:36.446264 14601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: Bootstrap starting.
I20260812 16:44:36.446599 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.437215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40074 (local address 127.21.114.126:42217)
0812 16:44:36.437257 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.437259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.437296 (+ 37us) server_negotiation.cc:407] Connection header received
0812 16:44:36.437374 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.437374 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.437383 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.437437 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.437979 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.438640 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.439566 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.439866 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.439934 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.443110 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.443111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.443112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.443118 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.445422 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.445836 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.445837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.445837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.445896 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.446077 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.446078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.446079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.446204 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.446346 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.446442 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.446515 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:44:36.447127 14601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:36.447505 14601 log.cc:824] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:36.448475 14601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: No bootstrap required, opened a new log
I20260812 16:44:36.450613 14601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.450780 14601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:36.450874 14601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed9558de91b4833a77495cf9a13d9b1, State: Initialized, Role: FOLLOWER
I20260812 16:44:36.451009 14601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:44:36.451359 14601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:36.451330 14855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.451603 14855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
W20260812 16:44:36.454030 14872 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:44:36.454085 14872 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:44:36.454731 14847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.445764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44556)
0812 16:44:36.445804 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.445813 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.445851 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.448026 (+ 2175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.448027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.448170 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.448199 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.448200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.448932 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.448933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.449381 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.449382 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.449766 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.449767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.449816 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.450218 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.450223 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.451639 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.453506 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.453507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.453507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.453717 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.454073 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.454074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.454074 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.454136 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.454441 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.454442 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.454482 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.454529 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.454616 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 16:44:36.455040 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.447834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44556 (local address 127.21.114.124:40303)
0812 16:44:36.447900 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.447902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.447910 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:44:36.447930 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.447931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.447942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.448248 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.448262 (+ 14us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.448837 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.449465 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.449682 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.449766 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.451725 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.451726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.451726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.451733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.453417 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.453791 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.453792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.453792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.453993 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.454200 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.454201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.454201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.454365 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.454847 (+ 482us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.454885 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.454956 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:44:36.455519 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.447249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55838 (local address 127.21.114.125:41287)
0812 16:44:36.447286 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.447287 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.447318 (+ 31us) server_negotiation.cc:407] Connection header received
0812 16:44:36.447402 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.447403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.447410 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.447453 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.448018 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.448704 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.449603 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.449889 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.449951 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.452563 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.452564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.452565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.452572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.454217 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.454601 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.454602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.454602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.454656 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.454865 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.454867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.454867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.454989 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.455133 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.455336 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.455408 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 16:44:36.454761 14486 master_runner.cc:186] Error getting master registration for 127.21.114.125:41287: OK, instance_id { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" instance_seqno: 1786553076244606 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 16:44:36.457712 14486 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 16:44:36.458107 14844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: Bootstrap starting.
I20260812 16:44:36.458892 14844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:36.459239 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:44:36.459232 14844 log.cc:824] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:36.459981 14844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: No bootstrap required, opened a new log
I20260812 16:44:36.462513 14844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.462654 14844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:36.462683 14844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f10befbe964d919e441fd41ac439c7, State: Initialized, Role: FOLLOWER
I20260812 16:44:36.462813 14844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.463148 14844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:36.464775 14891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.464893 14891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:44:36.469703 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.460866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.21.114.126:42217)
0812 16:44:36.460914 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.460917 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.461201 (+ 284us) server_negotiation.cc:407] Connection header received
0812 16:44:36.461296 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.461297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.461307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.461335 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.462078 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.462743 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.463959 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.464279 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.464355 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.466649 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.466650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.466650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.466657 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.468300 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.468775 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.468776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.468777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.468831 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.469047 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.469047 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.469048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.469187 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.469263 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.469528 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.469605 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:44:36.466313 14735 master_runner.cc:186] Error getting master registration for 127.21.114.125:41287: OK, instance_id { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" instance_seqno: 1786553076244606 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 16:44:36.470527 14735 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 16:44:36.471539 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.460918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55850 (local address 127.21.114.125:41287)
0812 16:44:36.460953 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.460955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.461095 (+ 140us) server_negotiation.cc:407] Connection header received
0812 16:44:36.461211 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.461212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.461222 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.461250 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.461978 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.462697 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.463726 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.464032 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.464075 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.468394 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.468396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.468396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.468404 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.470086 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.470672 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.470673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.470674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.470736 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.470981 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.470982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.470982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.471118 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.471221 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.471347 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.471420 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 16:44:36.473055 14912 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:44:36.473115 14912 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:44:36.474242 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.461008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44570 (local address 127.21.114.124:40303)
0812 16:44:36.461045 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.461047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.465076 (+ 4029us) server_negotiation.cc:407] Connection header received
0812 16:44:36.465178 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.465179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.465188 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.465232 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.465826 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.466535 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.467489 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.467782 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.467859 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.471290 (+ 3431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.471291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.471291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.471299 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.473001 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.473446 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.473447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.473447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.473503 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.473721 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.473721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.473722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.473838 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.473971 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.474066 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.474139 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:44:36.483634 14727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } attempt: 3
Aug 12 16:44:36 dist-test-slave-45dx krb5kdc[14460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553076, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:44:36.490682 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.483905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40303 (local address 127.0.0.1:44580)
0812 16:44:36.483956 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:36.483967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:36.484007 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:36.484117 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:36.484118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:36.484262 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:36.484340 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.484342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.484951 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.484952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.485521 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:36.485523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.485881 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.485882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:36.485946 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.486845 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:36.486851 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:36.488050 (+ 1199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:36.489670 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.489672 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.489672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.489854 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.490044 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:36.490045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:36.490045 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:36.490101 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:36.490363 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:36.490363 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:36.490408 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 16:44:36.490495 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 16:44:36.490592 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 16:44:36.490681 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:36.483946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44580 (local address 127.21.114.124:40303)
0812 16:44:36.483981 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:36.483983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:36.483993 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:44:36.484056 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:36.484057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:36.484067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:36.484115 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:36.484403 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.484862 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.485602 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:36.485795 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:36.485872 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:36.488139 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:36.488140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:36.488141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:36.488148 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:36.489566 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.489929 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.489931 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.489931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.489990 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:36.490174 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:36.490175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:36.490175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:36.490286 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:36.490370 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:36.490520 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 16:44:36.490591 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:44:36.492569 14727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c: Bootstrap starting.
I20260812 16:44:36.493247 14727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:36.493495 14727 log.cc:824] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:36.494237 14727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c: No bootstrap required, opened a new log
I20260812 16:44:36.495637 14727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.495772 14727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:36.495836 14727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82401e5d6a4946328ea24ed15960eb4c, State: Initialized, Role: FOLLOWER
I20260812 16:44:36.495995 14727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.496402 14727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:36.496447 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.496622 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: This master's current role is: FOLLOWER
W20260812 16:44:36.498368 14944 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:44:36.498504 14944 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:44:36.500129 14613 master_runner.cc:263] No leader master found from master 82401e5d6a4946328ea24ed15960eb4c
I20260812 16:44:36.500183 14613 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 16:44:36.588428 14520 tablet.cc:2369] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:44:36.601570 14922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:44:36.601711 14922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.602025 14922 leader_election.cc:288] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ed9558de91b4833a77495cf9a13d9b1 (127.21.114.126:42217), 18f10befbe964d919e441fd41ac439c7 (127.21.114.124:40303)
I20260812 16:44:36.602406 14806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82401e5d6a4946328ea24ed15960eb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f10befbe964d919e441fd41ac439c7" is_pre_election: true
I20260812 16:44:36.602612 14806 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82401e5d6a4946328ea24ed15960eb4c in term 0.
I20260812 16:44:36.602995 14555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82401e5d6a4946328ea24ed15960eb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed9558de91b4833a77495cf9a13d9b1" is_pre_election: true
I20260812 16:44:36.603179 14555 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82401e5d6a4946328ea24ed15960eb4c in term 0.
I20260812 16:44:36.603549 14641 leader_election.cc:302] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ed9558de91b4833a77495cf9a13d9b1, 82401e5d6a4946328ea24ed15960eb4c; no voters:
I20260812 16:44:36.603782 14922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:44:36.603844 14922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:44:36.603876 14922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:36.604879 14922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.605000 14922 leader_election.cc:288] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [CANDIDATE]: Term 1 election: Requested vote from peers 5ed9558de91b4833a77495cf9a13d9b1 (127.21.114.126:42217), 18f10befbe964d919e441fd41ac439c7 (127.21.114.124:40303)
I20260812 16:44:36.605399 14555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82401e5d6a4946328ea24ed15960eb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed9558de91b4833a77495cf9a13d9b1"
I20260812 16:44:36.605475 14555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:36.606353 14555 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82401e5d6a4946328ea24ed15960eb4c in term 1.
I20260812 16:44:36.606585 14806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82401e5d6a4946328ea24ed15960eb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f10befbe964d919e441fd41ac439c7"
I20260812 16:44:36.606671 14806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:36.607565 14806 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82401e5d6a4946328ea24ed15960eb4c in term 1.
I20260812 16:44:36.607800 14641 leader_election.cc:302] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f10befbe964d919e441fd41ac439c7, 82401e5d6a4946328ea24ed15960eb4c; no voters:
I20260812 16:44:36.608031 14922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:36.608186 14922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [term 1 LEADER]: Becoming Leader. State: Replica: 82401e5d6a4946328ea24ed15960eb4c, State: Running, Role: LEADER
I20260812 16:44:36.608275 14922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } }
I20260812 16:44:36.608691 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82401e5d6a4946328ea24ed15960eb4c. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.608763 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:36.609985 14950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:36.610225 14950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:36.612915 14806 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [term 1 FOLLOWER]: Refusing update from remote peer 82401e5d6a4946328ea24ed15960eb4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:36.613297 14922 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:36.614653 14891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82401e5d6a4946328ea24ed15960eb4c. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.614741 14891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:44:36.615187 14555 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [term 1 FOLLOWER]: Refusing update from remote peer 82401e5d6a4946328ea24ed15960eb4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:36.615515 14922 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:36.616822 14855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82401e5d6a4946328ea24ed15960eb4c. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.616914 14855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:44:36.618323 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.618423 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:36.618855 14855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.618932 14855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:44:36.619210 14956 mvcc.cc:205] Tried to move back new op lower bound from 7317721401804062720 to 7317721401788133376. Current Snapshot: MvccSnapshot[applied={T|T < 7317721401804062720}]
I20260812 16:44:36.619748 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.619838 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:36.620165 14891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82401e5d6a4946328ea24ed15960eb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ed9558de91b4833a77495cf9a13d9b1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42217 } } peers { permanent_uuid: "82401e5d6a4946328ea24ed15960eb4c" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 41287 } } peers { permanent_uuid: "18f10befbe964d919e441fd41ac439c7" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40303 } } }
I20260812 16:44:36.620242 14891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:44:36.620726 14954 mvcc.cc:205] Tried to move back new op lower bound from 7317721401804062720 to 7317721401788133376. Current Snapshot: MvccSnapshot[applied={T|T < 7317721401804062720}]
I20260812 16:44:36.623476 14950 catalog_manager.cc:1347] Generated new cluster ID: c0a8eb6ad0ac4fea99ad875f31ad04f1
I20260812 16:44:36.623525 14950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:44:36.637226 14950 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:44:36.638075 14950 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:36.647089 14950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82401e5d6a4946328ea24ed15960eb4c: Generated new TSK 0
I20260812 16:44:36.647298 14950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:44:37.454602 14872 catalog_manager.cc:1259] Loaded cluster ID: c0a8eb6ad0ac4fea99ad875f31ad04f1
I20260812 16:44:37.454689 14872 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: loading cluster ID for follower catalog manager: success
I20260812 16:44:37.455490 14872 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: acquiring CA information for follower catalog manager: success
I20260812 16:44:37.455770 14872 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5ed9558de91b4833a77495cf9a13d9b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:44:37.473615 14912 catalog_manager.cc:1259] Loaded cluster ID: c0a8eb6ad0ac4fea99ad875f31ad04f1
I20260812 16:44:37.473696 14912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: loading cluster ID for follower catalog manager: success
I20260812 16:44:37.474560 14912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: acquiring CA information for follower catalog manager: success
I20260812 16:44:37.474947 14912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18f10befbe964d919e441fd41ac439c7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:44:37.697636 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 14486
I20260812 16:44:37.738121 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 14613
I20260812 16:44:37.755358 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 14735
2026-08-12T16:44:37Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3250 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:44:37 dist-test-slave-45dx krb5kdc[14979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:44:37 dist-test-slave-45dx krb5kdc[14979](info): set up 2 sockets
Aug 12 16:44:37 dist-test-slave-45dx krb5kdc[14979](info): commencing operation
krb5kdc: starting...
W20260812 16:44:39.120064 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:44:39 dist-test-slave-45dx krb5kdc[14979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:44:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:44:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:44:39.251132 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33291
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:33249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:39.334574 14997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:39.334781 14997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:39.334805 14997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:39.336040 14997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:39.336082 14997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:39.336097 14997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:39.336110 14997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:39.336155 14997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:39.337641 14997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:33249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:39.337906 14997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:39.338155 14997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:39.342995 15005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:39.342990 15006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:39.343032 15009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:39.343333 14997 server_base.cc:1034] running on GCE node
I20260812 16:44:39.343598 14997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:39.343891 14997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:39.345032 14997 hybrid_clock.cc:648] HybridClock initialized: now 1786553079345014 us; error 35 us; skew 500 ppm
Aug 12 16:44:39 dist-test-slave-45dx krb5kdc[14979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553079, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:39.351680 14997 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:39.352203 14997 webserver.cc:460] Webserver started at http://127.21.114.126:43845/ using document root <none> and password file <none>
I20260812 16:44:39.352497 14997 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:39.352547 14997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:39.352705 14997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:39.353775 14997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "29098b723da84b1f8cb4ef8a9340fdfb"
format_stamp: "Formatted at 2026-08-12 16:44:39 on dist-test-slave-45dx"
server_key: "fc3f351ba5ee9c30e9275059a24d6766"
server_key_iv: "9ae26cb0bf5a42d15b2d07a904999ec5"
server_key_version: "encryptionkey@0"
I20260812 16:44:39.354154 14997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "29098b723da84b1f8cb4ef8a9340fdfb"
format_stamp: "Formatted at 2026-08-12 16:44:39 on dist-test-slave-45dx"
server_key: "fc3f351ba5ee9c30e9275059a24d6766"
server_key_iv: "9ae26cb0bf5a42d15b2d07a904999ec5"
server_key_version: "encryptionkey@0"
I20260812 16:44:39.355589 14997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:44:39.356431 15020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:39.356628 14997 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:39.356726 14997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "29098b723da84b1f8cb4ef8a9340fdfb"
format_stamp: "Formatted at 2026-08-12 16:44:39 on dist-test-slave-45dx"
server_key: "fc3f351ba5ee9c30e9275059a24d6766"
server_key_iv: "9ae26cb0bf5a42d15b2d07a904999ec5"
server_key_version: "encryptionkey@0"
I20260812 16:44:39.356802 14997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:39.397806 14997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:39.399775 14997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:39.399941 14997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:39.404215 14997 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33291
I20260812 16:44:39.404284 15116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33291 every 8 connection(s)
I20260812 16:44:39.404640 14997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:39.405552 15117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:39.406562 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 14997
I20260812 16:44:39.406654 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:44:39.406875 21961 external_mini_cluster.cc:1428] Setting key d6151f318fc4b61ac30d7a7388674d4c
I20260812 16:44:39.409063 15117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb: Bootstrap starting.
I20260812 16:44:39.409713 15117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:39.410046 15117 log.cc:824] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:39.410761 15117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb: No bootstrap required, opened a new log
I20260812 16:44:39.412639 15117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33291 } }
I20260812 16:44:39.412814 15117 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:39.412863 15117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29098b723da84b1f8cb4ef8a9340fdfb, State: Initialized, Role: FOLLOWER
I20260812 16:44:39.413017 15117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33291 } }
I20260812 16:44:39.413095 15117 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:39.413138 15117 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:39.413190 15117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 0 FOLLOWER]: Advancing to term 1
Aug 12 16:44:39 dist-test-slave-45dx krb5kdc[14979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:39.413774 15117 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33291 } }
I20260812 16:44:39.413894 15117 leader_election.cc:302] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29098b723da84b1f8cb4ef8a9340fdfb; no voters:
I20260812 16:44:39.414076 15117 leader_election.cc:288] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:44:39.414155 15123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:39.414379 15117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:39.414649 15123 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [term 1 LEADER]: Becoming Leader. State: Replica: 29098b723da84b1f8cb4ef8a9340fdfb, State: Running, Role: LEADER
I20260812 16:44:39.414747 15123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33291 } }
I20260812 16:44:39.415410 15126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29098b723da84b1f8cb4ef8a9340fdfb. Latest consensus state: current_term: 1 leader_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33291 } } }
I20260812 16:44:39.415412 15124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29098b723da84b1f8cb4ef8a9340fdfb" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33291 } } }
I20260812 16:44:39.415520 15126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:39.415524 15124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:39.415743 15136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:39.416347 15136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:39.417968 15120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:39.407390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59918 (local address 127.21.114.126:33291)
0812 16:44:39.407562 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:39.407570 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:39.407596 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:44:39.408032 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:39.408039 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:39.408086 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:39.408201 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:39.409067 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:39.410061 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:39.410857 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:39.411289 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:39.411415 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:39.413987 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:39.413991 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:39.413991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:39.414003 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:39.416319 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:39.416731 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:39.416734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:39.416735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:39.416841 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:39.417076 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:39.417077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:39.417078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:39.417346 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:39.417505 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:39.417633 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 16:44:39.417777 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260812 16:44:39.418424 15136 catalog_manager.cc:1347] Generated new cluster ID: d7cf4a5d22c546cdb9cdd2738d66f7c6
I20260812 16:44:39.418478 15136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:44:39.420855 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:44:39.428493 15136 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:44:39.429040 15136 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:39.441653 15136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29098b723da84b1f8cb4ef8a9340fdfb: Generated new TSK 0
I20260812 16:44:39.441892 15136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:44:39.475229 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 14997
2026-08-12T16:44:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1717 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:44:39 dist-test-slave-45dx krb5kdc[15153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:44:39 dist-test-slave-45dx krb5kdc[15153](info): set up 2 sockets
Aug 12 16:44:39 dist-test-slave-45dx krb5kdc[15153](info): commencing operation
krb5kdc: starting...
W20260812 16:44:40.788895 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:44:40 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:44:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:44:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:44:40.914770 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38065
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:38065
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:40.998312 15173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:40.998515 15173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:40.998538 15173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:40.999593 15173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:40.999626 15173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:40.999640 15173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:40.999653 15173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:40.999665 15173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:41.001199 15173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:38065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:41.001397 15173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:41.001574 15173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:41.006774 15188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.006840 15180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.006783 15181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.007014 15173 server_base.cc:1034] running on GCE node
I20260812 16:44:41.007349 15173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:41.007617 15173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:41.008777 15173 hybrid_clock.cc:648] HybridClock initialized: now 1786553081008751 us; error 42 us; skew 500 ppm
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:41.011534 15173 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:41.011943 15173 webserver.cc:460] Webserver started at http://127.21.114.126:40439/ using document root <none> and password file <none>
I20260812 16:44:41.012151 15173 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:41.012190 15173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:41.012286 15173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:41.013396 15173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "ad0e8be7d4b4d7d953a8c8f31adfcfb7"
server_key_iv: "56e591a7a8e8bb046a195c371b0746bb"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.013697 15173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "ad0e8be7d4b4d7d953a8c8f31adfcfb7"
server_key_iv: "56e591a7a8e8bb046a195c371b0746bb"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.014987 15173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:44:41.015700 15197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.015906 15173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:41.016021 15173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "ad0e8be7d4b4d7d953a8c8f31adfcfb7"
server_key_iv: "56e591a7a8e8bb046a195c371b0746bb"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.016101 15173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:41.028730 15173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:41.031204 15173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:41.031389 15173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:41.035344 15173 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:38065
I20260812 16:44:41.035404 15298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:38065 every 8 connection(s)
I20260812 16:44:41.035794 15173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:41.036929 15300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:41.039294 15300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap starting.
I20260812 16:44:41.039913 15300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:41.040210 15300 log.cc:824] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:41.040501 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 15173
I20260812 16:44:41.040647 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:44:41.040858 21961 external_mini_cluster.cc:1428] Setting key 8724a1cdfe9efdf37982e2d930f5e59d
I20260812 16:44:41.041141 15300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: No bootstrap required, opened a new log
I20260812 16:44:41.043371 15300 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.043560 15300 raft_consensus.cc:374] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:41.043596 15300 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb3b95fe28b4ee2a78d55bb0d8efff2, State: Initialized, Role: FOLLOWER
I20260812 16:44:41.043728 15300 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.043834 15300 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:41.043871 15300 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:41.043929 15300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:41.044680 15300 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.044792 15300 leader_election.cc:302] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccb3b95fe28b4ee2a78d55bb0d8efff2; no voters:
I20260812 16:44:41.044953 15300 leader_election.cc:288] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:44:41.045038 15315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:41.045192 15300 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:41.045236 15315 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 LEADER]: Becoming Leader. State: Replica: ccb3b95fe28b4ee2a78d55bb0d8efff2, State: Running, Role: LEADER
I20260812 16:44:41.045478 15315 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.046005 15319 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccb3b95fe28b4ee2a78d55bb0d8efff2. Latest consensus state: current_term: 1 leader_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } } }
I20260812 16:44:41.046109 15319 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:41.046269 15318 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } } }
I20260812 16:44:41.046339 15318 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:41.046311 15334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:41.046967 15334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:41.048771 15334 catalog_manager.cc:1347] Generated new cluster ID: 8608156e922144c89cdffad822d1a0fc
I20260812 16:44:41.048844 15334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:41.053983 15309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.041453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35606 (local address 127.21.114.126:38065)
0812 16:44:41.041687 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.041698 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.041745 (+ 47us) server_negotiation.cc:407] Connection header received
0812 16:44:41.042585 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.042596 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.042663 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.042822 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:41.043525 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.045298 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.046465 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.047066 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.047512 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.050077 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:41.050081 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:41.050081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:41.050095 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:41.052233 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.052679 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.052682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.052683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.052803 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.053016 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.053017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.053018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.053361 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:41.053545 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.053617 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.053764 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260812 16:44:41.066468 15334 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:44:41.067061 15334 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:41.072774 15334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Generated new TSK 0
I20260812 16:44:41.073007 15334 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:44:41.103370 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38065
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:41.188899 15355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:41.189100 15355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:41.189123 15355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:41.190196 15355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:41.190229 15355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:41.190254 15355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:44:41.191682 15355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:41.191869 15355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:41.192045 15355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:41.197283 15364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.197293 15363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.197293 15370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.197598 15355 server_base.cc:1034] running on GCE node
I20260812 16:44:41.197881 15355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:41.198148 15355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:41.199293 15355 hybrid_clock.cc:648] HybridClock initialized: now 1786553081199282 us; error 33 us; skew 500 ppm
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:41.201915 15355 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:44:41.202402 15355 webserver.cc:460] Webserver started at http://127.21.114.65:33983/ using document root <none> and password file <none>
I20260812 16:44:41.202674 15355 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:41.202749 15355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:41.202894 15355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:41.203902 15355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "25549ebd98324ac9998e3ad668441bae"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "bb36637a8d77f0cbf602d92a262e81e4"
server_key_iv: "cb98809a22599f353341976bb268ca34"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.204190 15355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "25549ebd98324ac9998e3ad668441bae"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "bb36637a8d77f0cbf602d92a262e81e4"
server_key_iv: "cb98809a22599f353341976bb268ca34"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.205578 15355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:41.206247 15386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.206436 15355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:44:41.206530 15355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "25549ebd98324ac9998e3ad668441bae"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "bb36637a8d77f0cbf602d92a262e81e4"
server_key_iv: "cb98809a22599f353341976bb268ca34"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.206604 15355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:41.220290 15355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:41.222262 15355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:41.222427 15355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:41.222669 15355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:41.222985 15355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:41.223018 15355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.223042 15355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:41.223086 15355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.229094 15355 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:43731
I20260812 16:44:41.229139 15615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:43731 every 8 connection(s)
I20260812 16:44:41.229504 15355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:41.238595 15309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.230272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:58345 (local address 127.21.114.126:38065)
0812 16:44:41.230364 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.230366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.230536 (+ 170us) server_negotiation.cc:407] Connection header received
0812 16:44:41.231020 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.231021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.231031 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.231083 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:41.231996 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.232561 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.233530 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.233729 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.233782 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.235864 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:41.235869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:41.235870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:41.235876 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:41.237193 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.237595 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.237596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.237596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.237655 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.237934 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.237935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.237935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.238050 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:41.238123 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.238414 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.238498 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 16:44:41.238803 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.230215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:58345)
0812 16:44:41.230411 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.230449 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.230937 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.231138 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.231142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.231713 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:41.231914 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.231919 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.232640 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.232641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.233450 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.233452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.233804 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.233805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.233925 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.234387 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:41.234396 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:41.235748 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:41.237277 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:41.237284 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:41.237287 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:41.237515 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:41.237722 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:41.237723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:41.237724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:41.237855 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:41.238127 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:41.238135 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:41.238272 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.238390 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.238556 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":109,"threads_started":1}
I20260812 16:44:41.239172 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 15355
I20260812 16:44:41.239272 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:44:41.239336 15616 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38065
I20260812 16:44:41.239440 15616 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:41.239507 21961 external_mini_cluster.cc:1428] Setting key 911c4950a75ddae1dc28f3000c04abce
I20260812 16:44:41.239637 15616 heartbeater.cc:511] Master 127.21.114.126:38065 requested a full tablet report, sending...
I20260812 16:44:41.240195 15230 ts_manager.cc:194] Registered new tserver with Master: 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731)
I20260812 16:44:41.241132 15230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:58345
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:44:41.267014 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38065
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:41.349766 15623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:41.349973 15623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:41.349997 15623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:41.351125 15623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:41.351166 15623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:41.351217 15623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:44:41.352665 15623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:41.352906 15623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:41.353225 15623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:41.358263 15631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.358263 15636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.358552 15623 server_base.cc:1034] running on GCE node
W20260812 16:44:41.358269 15632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.358800 15623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:41.359052 15623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:41.360217 15623 hybrid_clock.cc:648] HybridClock initialized: now 1786553081360210 us; error 36 us; skew 500 ppm
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:41.362746 15623 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:44:41.363220 15623 webserver.cc:460] Webserver started at http://127.21.114.66:37207/ using document root <none> and password file <none>
I20260812 16:44:41.363461 15623 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:41.363528 15623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:41.363667 15623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:41.364786 15623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "347bf015f3f443df9f3cbc7cb3036624"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "865177c1a499f11fd9756e4fe049b0d9"
server_key_iv: "1c18ac96817e44915ce00a4823e86f34"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.365162 15623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "347bf015f3f443df9f3cbc7cb3036624"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "865177c1a499f11fd9756e4fe049b0d9"
server_key_iv: "1c18ac96817e44915ce00a4823e86f34"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.366469 15623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:44:41.367146 15654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.367319 15623 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:41.367452 15623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "347bf015f3f443df9f3cbc7cb3036624"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "865177c1a499f11fd9756e4fe049b0d9"
server_key_iv: "1c18ac96817e44915ce00a4823e86f34"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.367534 15623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:41.377177 15623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:41.378906 15623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:41.379065 15623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:41.379274 15623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:41.379599 15623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:41.379660 15623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.379701 15623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:41.379729 15623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.385656 15623 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:40035
I20260812 16:44:41.385692 15857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:40035 every 8 connection(s)
I20260812 16:44:41.386013 15623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:41.392026 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 15623
I20260812 16:44:41.392102 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:44:41.392333 21961 external_mini_cluster.cc:1428] Setting key ac7b5deb8eb3db35f35f4465ca639af3
I20260812 16:44:41.395269 15309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.386767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:51691 (local address 127.21.114.126:38065)
0812 16:44:41.386837 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.386839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.387019 (+ 180us) server_negotiation.cc:407] Connection header received
0812 16:44:41.387478 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.387479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.387489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.387545 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:41.388501 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.388989 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.389937 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.390120 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.390171 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.392203 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:41.392204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:41.392205 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:41.392213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:41.393893 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.394288 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.394290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.394290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.394351 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.394616 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.394617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.394618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.394737 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:41.394813 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.395095 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.395181 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:44:41.395503 15862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.386731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:51691)
0812 16:44:41.386885 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.386926 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.387395 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.387596 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.387600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.388163 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:41.388423 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.388429 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.389079 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.389080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.389862 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.389864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.390192 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.390193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.390288 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.390748 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:41.390757 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:41.392065 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:41.393976 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:41.393983 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:41.393986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:41.394206 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:41.394433 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:41.394434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:41.394434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:41.394540 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:41.394804 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:41.394811 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:41.394952 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.395059 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.395214 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260812 16:44:41.396049 15858 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38065
I20260812 16:44:41.396142 15858 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:41.396375 15858 heartbeater.cc:511] Master 127.21.114.126:38065 requested a full tablet report, sending...
I20260812 16:44:41.396808 15230 ts_manager.cc:194] Registered new tserver with Master: 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035)
I20260812 16:44:41.397333 15230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:51691
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:44:41.419054 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38065
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:41.505724 15865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:41.505997 15865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:41.506023 15865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:41.507158 15865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:41.507192 15865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:41.507217 15865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:44:41.508597 15865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:41.508780 15865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:41.508955 15865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:44:41.514070 15865 server_base.cc:1034] running on GCE node
W20260812 16:44:41.514043 15876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.514024 15874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.514024 15873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.514516 15865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:41.514778 15865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:41.515921 15865 hybrid_clock.cc:648] HybridClock initialized: now 1786553081515899 us; error 46 us; skew 500 ppm
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:41.518416 15865 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:44:41.518909 15865 webserver.cc:460] Webserver started at http://127.21.114.67:46873/ using document root <none> and password file <none>
I20260812 16:44:41.519133 15865 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:41.519178 15865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:41.519336 15865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:41.520517 15865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "b6de8c3a35ed4c3384df74f542736306"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "2018e6011aa420c9671af40e40375f0c"
server_key_iv: "c4a056d36b73d295a7ccaddb1140c0b3"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.520885 15865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "b6de8c3a35ed4c3384df74f542736306"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "2018e6011aa420c9671af40e40375f0c"
server_key_iv: "c4a056d36b73d295a7ccaddb1140c0b3"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.522254 15865 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:41.522976 15886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.523168 15865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:41.523249 15865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "b6de8c3a35ed4c3384df74f542736306"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "2018e6011aa420c9671af40e40375f0c"
server_key_iv: "c4a056d36b73d295a7ccaddb1140c0b3"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.523303 15865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:41.549355 15865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:41.551796 15865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:41.551940 15865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:41.552145 15865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:41.552497 15865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:41.552536 15865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.552558 15865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:41.552572 15865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.558733 15865 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:39289
I20260812 16:44:41.558775 16089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:39289 every 8 connection(s)
I20260812 16:44:41.559149 15865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:44:41.564594 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 15865
I20260812 16:44:41.564693 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:44:41.564878 21961 external_mini_cluster.cc:1428] Setting key 0a32cc2b308e0ae34d30de246a1d7526
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:41.568368 15309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.559906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:52371 (local address 127.21.114.126:38065)
0812 16:44:41.559964 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.559967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.560148 (+ 181us) server_negotiation.cc:407] Connection header received
0812 16:44:41.560700 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.560701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.560710 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.560769 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:41.561680 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.562187 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.563130 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.563308 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.563366 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.565805 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:41.565807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:41.565808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:41.565815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:41.566962 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.567359 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.567360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.567360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.567428 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.567688 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.567689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.567690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.567814 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:41.567893 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.568168 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.568252 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 16:44:41.568574 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.559838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:52371)
0812 16:44:41.560013 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.560055 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.560614 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.560825 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.560828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.561406 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:41.561604 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.561610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.562265 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.562265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.563056 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.563058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.563395 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.563396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.563496 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.563960 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:41.563969 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:41.565711 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:41.567044 (+ 1333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:41.567051 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:41.567054 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:41.567280 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:41.567497 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:41.567498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:41.567498 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:41.567612 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:41.567888 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:41.567895 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:41.568036 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.568145 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.568307 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260812 16:44:41.569063 16090 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38065
I20260812 16:44:41.569166 16090 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:41.569339 16090 heartbeater.cc:511] Master 127.21.114.126:38065 requested a full tablet report, sending...
I20260812 16:44:41.569738 15230 ts_manager.cc:194] Registered new tserver with Master: b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289)
I20260812 16:44:41.570135 15230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:52371
I20260812 16:44:41.576737 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:44:41.584372 15309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.577974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35618 (local address 127.21.114.126:38065)
0812 16:44:41.578065 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.578067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.578169 (+ 102us) server_negotiation.cc:407] Connection header received
0812 16:44:41.578247 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.578248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.578258 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.578313 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:41.578878 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.579352 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.580102 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.580353 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.580415 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.581661 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:41.581662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:41.581663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:41.581669 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:41.583112 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.583482 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.583483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.583483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.583545 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:41.583752 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:41.583754 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:41.583754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:41.583908 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:41.584013 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.584163 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.584242 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 16:44:41.586215 15230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:44:41.587875 15230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:44:41.595018 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.590535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:39289 (local address 127.0.0.1:36722)
0812 16:44:41.590911 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.590925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.591028 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.591329 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.591330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.591332 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:41.591372 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.591373 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.592340 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.592342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.593759 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.593762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.594643 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.594643 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.594750 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.594766 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.594855 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.594920 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":101,"thread_start_us":79,"threads_started":1}
I20260812 16:44:41.595044 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.590653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36722 (local address 127.21.114.67:39289)
0812 16:44:41.590878 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.590882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.590995 (+ 113us) server_negotiation.cc:407] Connection header received
0812 16:44:41.591131 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.591135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.591153 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.591208 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:41.591453 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.592200 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.593939 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.594515 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.594554 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.594593 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.594892 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.594949 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":124,"threads_started":1}
I20260812 16:44:41.595018 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.590323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43731 (local address 127.0.0.1:37254)
0812 16:44:41.590488 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.590526 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.590591 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.591175 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.591178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.591181 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:41.591251 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.591253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.592643 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.592644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.593693 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.593696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.594734 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.594735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.594787 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.594790 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.594856 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.594921 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":84,"thread_start_us":48,"threads_started":1}
I20260812 16:44:41.595434 16106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.590469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57240 (local address 127.21.114.66:40035)
0812 16:44:41.590736 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.590740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.590875 (+ 135us) server_negotiation.cc:407] Connection header received
0812 16:44:41.590958 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.590961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.590982 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.591071 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:41.591346 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.592531 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.594099 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.594920 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.594992 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.595048 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.595282 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.595331 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":119,"threads_started":1}
I20260812 16:44:41.595569 16109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.590716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.21.114.65:43731)
0812 16:44:41.590991 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.590995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.591005 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:44:41.591045 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.591047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.591065 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.591358 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:41.591451 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.592531 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.593821 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.594631 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.594719 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.594779 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.595407 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.595463 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":90,"threads_started":1}
I20260812 16:44:41.595691 16107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.590323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40035 (local address 127.0.0.1:57240)
0812 16:44:41.590798 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.590810 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.590871 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.591182 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.591183 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.591186 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:41.591256 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.591258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.592666 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.592667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.594035 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.594038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.595090 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.595092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.595165 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.595170 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.595554 (+ 384us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.595607 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":46,"thread_start_us":71,"threads_started":1}
I20260812 16:44:41.596340 15490 tablet_service.cc:1467] Processing CreateTablet for tablet dd16004bc14143afbb9268220e535dac (DEFAULT_TABLE table=test-table [id=d5ac8f0445e24f2ea2526456933ed5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:41.596424 15731 tablet_service.cc:1467] Processing CreateTablet for tablet dd16004bc14143afbb9268220e535dac (DEFAULT_TABLE table=test-table [id=d5ac8f0445e24f2ea2526456933ed5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:41.596524 15969 tablet_service.cc:1467] Processing CreateTablet for tablet dd16004bc14143afbb9268220e535dac (DEFAULT_TABLE table=test-table [id=d5ac8f0445e24f2ea2526456933ed5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:41.596757 15731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd16004bc14143afbb9268220e535dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:41.596767 15490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd16004bc14143afbb9268220e535dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:41.596913 15969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd16004bc14143afbb9268220e535dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:41.599558 16111 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Bootstrap starting.
I20260812 16:44:41.600450 16115 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Bootstrap starting.
I20260812 16:44:41.600616 16111 tablet_bootstrap.cc:654] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:41.601193 16115 tablet_bootstrap.cc:654] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:41.601217 16111 log.cc:824] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:41.601784 16115 log.cc:824] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:41.602066 16111 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: No bootstrap required, opened a new log
I20260812 16:44:41.602145 16111 ts_tablet_manager.cc:1397] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260812 16:44:41.602142 16117 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Bootstrap starting.
I20260812 16:44:41.602523 16115 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: No bootstrap required, opened a new log
I20260812 16:44:41.602613 16115 ts_tablet_manager.cc:1397] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 16:44:41.602767 16117 tablet_bootstrap.cc:654] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:41.603659 16117 log.cc:824] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:41.604491 16117 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: No bootstrap required, opened a new log
I20260812 16:44:41.604360 16111 raft_consensus.cc:348] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.604544 16111 raft_consensus.cc:374] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:41.604561 16117 ts_tablet_manager.cc:1397] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:44:41.604594 16111 raft_consensus.cc:729] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6de8c3a35ed4c3384df74f542736306, State: Initialized, Role: FOLLOWER
I20260812 16:44:41.604635 16115 raft_consensus.cc:348] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.604725 16111 consensus_queue.cc:260] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.604816 16115 raft_consensus.cc:374] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:41.604859 16115 raft_consensus.cc:729] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25549ebd98324ac9998e3ad668441bae, State: Initialized, Role: FOLLOWER
I20260812 16:44:41.604981 16115 consensus_queue.cc:260] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.605060 16111 ts_tablet_manager.cc:1428] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 16:44:41.605198 16090 heartbeater.cc:503] Master 127.21.114.126:38065 was elected leader, sending a full tablet report...
I20260812 16:44:41.605263 16115 ts_tablet_manager.cc:1428] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:44:41.605288 15616 heartbeater.cc:503] Master 127.21.114.126:38065 was elected leader, sending a full tablet report...
I20260812 16:44:41.606499 16117 raft_consensus.cc:348] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.606614 16117 raft_consensus.cc:374] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:41.606634 16117 raft_consensus.cc:729] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 347bf015f3f443df9f3cbc7cb3036624, State: Initialized, Role: FOLLOWER
I20260812 16:44:41.606763 16117 consensus_queue.cc:260] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.607043 16117 ts_tablet_manager.cc:1428] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 16:44:41.607088 15858 heartbeater.cc:503] Master 127.21.114.126:38065 was elected leader, sending a full tablet report...
W20260812 16:44:41.636605 15860 tablet.cc:2369] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:44:41.658567 16126 raft_consensus.cc:482] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:44:41.658703 16126 raft_consensus.cc:504] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.659039 16126 leader_election.cc:288] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035), b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289)
I20260812 16:44:41.661924 16106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.659330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:50963 (local address 127.21.114.66:40035)
0812 16:44:41.659404 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.659406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.659417 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:44:41.659489 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.659490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.659501 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.659560 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:41.659744 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.660220 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.661168 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.661552 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.661642 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.661652 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.661819 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.661854 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 16:44:41.661933 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.659260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40035 (local address 127.21.114.65:50963)
0812 16:44:41.659317 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.659339 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.659422 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.659574 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.659576 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.659578 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:41.659650 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.659652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.660336 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.660337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.661067 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.661069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.661639 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.661641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.661738 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.661741 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.661811 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.661852 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 16:44:41.662286 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd16004bc14143afbb9268220e535dac" candidate_uuid: "25549ebd98324ac9998e3ad668441bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "347bf015f3f443df9f3cbc7cb3036624" is_pre_election: true
I20260812 16:44:41.662438 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.659487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:59019 (local address 127.21.114.67:39289)
0812 16:44:41.659540 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.659543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.659692 (+ 149us) server_negotiation.cc:407] Connection header received
0812 16:44:41.659762 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.659763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.659772 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.659854 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:41.660024 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.660563 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.661610 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.662056 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.662139 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.662147 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.662335 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.662378 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 16:44:41.662437 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.659428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:39289 (local address 127.21.114.65:59019)
0812 16:44:41.659612 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.659621 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:41.659697 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:41.659865 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:41.659865 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:41.659867 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:41.659950 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.659952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.660655 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.660656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.661517 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:41.661519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.662179 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.662180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:41.662249 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.662252 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:44:41.662316 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:44:41.662361 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":128,"threads_started":1}
I20260812 16:44:41.662494 15763 raft_consensus.cc:2454] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25549ebd98324ac9998e3ad668441bae in term 0.
I20260812 16:44:41.662765 15391 leader_election.cc:302] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25549ebd98324ac9998e3ad668441bae, 347bf015f3f443df9f3cbc7cb3036624; no voters:
I20260812 16:44:41.662919 16126 raft_consensus.cc:2781] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:44:41.662912 16007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd16004bc14143afbb9268220e535dac" candidate_uuid: "25549ebd98324ac9998e3ad668441bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6de8c3a35ed4c3384df74f542736306" is_pre_election: true
I20260812 16:44:41.662981 16126 raft_consensus.cc:482] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:44:41.662998 16126 raft_consensus.cc:3037] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:41.663056 16007 raft_consensus.cc:2454] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25549ebd98324ac9998e3ad668441bae in term 0.
I20260812 16:44:41.663836 16126 raft_consensus.cc:504] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.663980 16126 leader_election.cc:288] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 1 election: Requested vote from peers 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035), b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289)
I20260812 16:44:41.664207 16007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd16004bc14143afbb9268220e535dac" candidate_uuid: "25549ebd98324ac9998e3ad668441bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6de8c3a35ed4c3384df74f542736306"
I20260812 16:44:41.664213 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd16004bc14143afbb9268220e535dac" candidate_uuid: "25549ebd98324ac9998e3ad668441bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "347bf015f3f443df9f3cbc7cb3036624"
I20260812 16:44:41.664291 16007 raft_consensus.cc:3037] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:41.664340 15763 raft_consensus.cc:3037] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:41.665072 16007 raft_consensus.cc:2454] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25549ebd98324ac9998e3ad668441bae in term 1.
I20260812 16:44:41.665082 15763 raft_consensus.cc:2454] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25549ebd98324ac9998e3ad668441bae in term 1.
I20260812 16:44:41.665241 15391 leader_election.cc:302] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25549ebd98324ac9998e3ad668441bae, b6de8c3a35ed4c3384df74f542736306; no voters:
I20260812 16:44:41.665350 16126 raft_consensus.cc:2781] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:41.665553 16126 raft_consensus.cc:686] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 LEADER]: Becoming Leader. State: Replica: 25549ebd98324ac9998e3ad668441bae, State: Running, Role: LEADER
I20260812 16:44:41.665683 16126 consensus_queue.cc:237] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:41.666575 15230 catalog_manager.cc:5495] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae reported cstate change: term changed from 0 to 1, leader changed from <none> to 25549ebd98324ac9998e3ad668441bae (127.21.114.65). New cstate: current_term: 1 leader_uuid: "25549ebd98324ac9998e3ad668441bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } health_report { overall_health: UNKNOWN } } }
I20260812 16:44:41.687228 16109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.685049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37260 (local address 127.21.114.65:43731)
0812 16:44:41.685115 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:41.685117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:41.685125 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:44:41.685194 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:41.685195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:41.685215 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:41.685276 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:44:41.685406 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.685868 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.686574 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:41.686754 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:41.686802 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:41.686934 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:44:41.687036 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:44:41.687104 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:41.687132 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 16:44:41.687149 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:44:41.689183 16007 raft_consensus.cc:1261] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Refusing update from remote peer 25549ebd98324ac9998e3ad668441bae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:41.689183 15763 raft_consensus.cc:1261] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Refusing update from remote peer 25549ebd98324ac9998e3ad668441bae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:41.689538 16126 consensus_queue.cc:1035] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:41.689703 16131 consensus_queue.cc:1035] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:41.692143 16136 mvcc.cc:205] Tried to move back new op lower bound from 7317721422595850240 to 7317721422503325696. Current Snapshot: MvccSnapshot[applied={T|T < 7317721422595850240}]
I20260812 16:44:41.693053 16139 mvcc.cc:205] Tried to move back new op lower bound from 7317721422595850240 to 7317721422503325696. Current Snapshot: MvccSnapshot[applied={T|T < 7317721422595850240}]
I20260812 16:44:41.694484 15229 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:44:41.694585 15229 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:44:41.695118 16138 mvcc.cc:205] Tried to move back new op lower bound from 7317721422595850240 to 7317721422503325696. Current Snapshot: MvccSnapshot[applied={T|T < 7317721422595850240}]
I20260812 16:44:41.695390 15229 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Sending DeleteTablet for 3 replicas of tablet dd16004bc14143afbb9268220e535dac
I20260812 16:44:41.695780 15731 tablet_service.cc:1514] Processing DeleteTablet for tablet dd16004bc14143afbb9268220e535dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:41 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:57240
I20260812 16:44:41.695779 15490 tablet_service.cc:1514] Processing DeleteTablet for tablet dd16004bc14143afbb9268220e535dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:41 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:37254
I20260812 16:44:41.695959 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 15355
I20260812 16:44:41.695986 15969 tablet_service.cc:1514] Processing DeleteTablet for tablet dd16004bc14143afbb9268220e535dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:41 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:36722
I20260812 16:44:41.705108 16155 tablet_replica.cc:330] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: stopping tablet replica
I20260812 16:44:41.705267 16155 raft_consensus.cc:2229] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:44:41.705395 16155 raft_consensus.cc:2258] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:41.706450 16152 tablet_replica.cc:330] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: stopping tablet replica
I20260812 16:44:41.706560 16152 raft_consensus.cc:2229] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:44:41.706666 16152 raft_consensus.cc:2258] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:41.707012 16155 ts_tablet_manager.cc:1905] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:44:41.708675 16152 ts_tablet_manager.cc:1905] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:44:41.709069 16155 ts_tablet_manager.cc:1918] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:44:41.709153 16155 log.cc:1196] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/dd16004bc14143afbb9268220e535dac
I20260812 16:44:41.709458 16155 ts_tablet_manager.cc:1939] T dd16004bc14143afbb9268220e535dac P b6de8c3a35ed4c3384df74f542736306: Deleting consensus metadata
I20260812 16:44:41.709978 15201 catalog_manager.cc:4841] TS b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289): tablet dd16004bc14143afbb9268220e535dac (table test-table [id=d5ac8f0445e24f2ea2526456933ed5c8]) successfully deleted
I20260812 16:44:41.710271 16152 ts_tablet_manager.cc:1918] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:44:41.710381 16152 log.cc:1196] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/dd16004bc14143afbb9268220e535dac
I20260812 16:44:41.710655 16152 ts_tablet_manager.cc:1939] T dd16004bc14143afbb9268220e535dac P 347bf015f3f443df9f3cbc7cb3036624: Deleting consensus metadata
I20260812 16:44:41.711091 15201 catalog_manager.cc:4841] TS 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035): tablet dd16004bc14143afbb9268220e535dac (table test-table [id=d5ac8f0445e24f2ea2526456933ed5c8]) successfully deleted
W20260812 16:44:41.713606 15203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:43731 (error 108)
I20260812 16:44:41.713932 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 15623
I20260812 16:44:41.727694 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:41.714058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43731 (local address 127.0.0.1:37270)
0812 16:44:41.727569 (+ 13511us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:41.727653 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13477}
W20260812 16:44:41.727916 15203 catalog_manager.cc:4584] TS 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd16004bc14143afbb9268220e535dac: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43731: connect: Connection refused (error 111)
I20260812 16:44:41.734014 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 15865
I20260812 16:44:41.746645 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 15173
I20260812 16:44:41.762562 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38065
--webserver_interface=127.21.114.126
--webserver_port=40439
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:38065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:41.845216 16158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:41.845435 16158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:41.845459 16158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:41.846611 16158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:41.846653 16158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:41.846668 16158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:41.846710 16158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:41.846742 16158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:41.848217 16158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:38065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=40439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:41.848505 16158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:41.848747 16158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:41.858490 16175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.858502 16169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.858507 16167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.858731 16158 server_base.cc:1034] running on GCE node
I20260812 16:44:41.859445 16158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:41.859774 16158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:41.860937 16158 hybrid_clock.cc:648] HybridClock initialized: now 1786553081860919 us; error 34 us; skew 500 ppm
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:41.863569 16158 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:41.864075 16158 webserver.cc:460] Webserver started at http://127.21.114.126:40439/ using document root <none> and password file <none>
I20260812 16:44:41.864392 16158 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:41.864482 16158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:41.865926 16158 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:41.866603 16184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:41.866791 16158 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:41.866899 16158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "ad0e8be7d4b4d7d953a8c8f31adfcfb7"
server_key_iv: "56e591a7a8e8bb046a195c371b0746bb"
server_key_version: "encryptionkey@0"
I20260812 16:44:41.867304 16158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:41.885847 16158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:41.887909 16158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:41.888077 16158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:41.892233 16158 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:38065
I20260812 16:44:41.892270 16274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:38065 every 8 connection(s)
I20260812 16:44:41.892722 16158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:41.894515 16276 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:44:41.895143 16276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap starting.
I20260812 16:44:41.898120 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 16158
I20260812 16:44:41.898451 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:43731
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:38065
--webserver_port=33983
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:41.904286 16276 log.cc:824] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:41.906277 16276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:41.906605 16276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap complete.
I20260812 16:44:41.909008 16276 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.909230 16276 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb3b95fe28b4ee2a78d55bb0d8efff2, State: Initialized, Role: FOLLOWER
I20260812 16:44:41.909411 16276 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.909473 16276 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:41.909539 16276 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:41.909592 16276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:44:41.910607 16276 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.910720 16276 leader_election.cc:302] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccb3b95fe28b4ee2a78d55bb0d8efff2; no voters:
I20260812 16:44:41.910921 16276 leader_election.cc:288] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 16:44:41.910957 16285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 16:44:41.911079 16285 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 LEADER]: Becoming Leader. State: Replica: ccb3b95fe28b4ee2a78d55bb0d8efff2, State: Running, Role: LEADER
I20260812 16:44:41.911181 16285 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:41.911211 16276 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:41.911490 16285 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccb3b95fe28b4ee2a78d55bb0d8efff2. Latest consensus state: current_term: 2 leader_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } } }
I20260812 16:44:41.911561 16285 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:41.911513 16289 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } } }
I20260812 16:44:41.911597 16289 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:41.911806 16292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:41.912724 16292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:41.912860 16292 catalog_manager.cc:1259] Loaded cluster ID: 8608156e922144c89cdffad822d1a0fc
I20260812 16:44:41.912899 16292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:44:41.913128 16292 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 16:44:41.917934 16292 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 16:44:41.920493 16292 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:41.920688 16292 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Loaded TSK: 0
I20260812 16:44:41.920923 16292 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 16:44:41.985734 16278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:41.985962 16278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:41.986001 16278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:41.987121 16278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:41.987187 16278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:41.987231 16278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:44:41.988750 16278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:43731
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=33983
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:41.989009 16278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:41.989256 16278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:41.994478 16330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:41.994422 16331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.994699 16278 server_base.cc:1034] running on GCE node
W20260812 16:44:41.994863 16335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:41.995074 16278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:41.995373 16278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:41.996551 16278 hybrid_clock.cc:648] HybridClock initialized: now 1786553081996536 us; error 28 us; skew 500 ppm
Aug 12 16:44:41 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:41.999555 16278 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:44:41.999981 16278 webserver.cc:460] Webserver started at http://127.21.114.65:33983/ using document root <none> and password file <none>
I20260812 16:44:42.000236 16278 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:42.000411 16278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:42.001855 16278 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:42.002606 16348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.002791 16278 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:42.002910 16278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "25549ebd98324ac9998e3ad668441bae"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "bb36637a8d77f0cbf602d92a262e81e4"
server_key_iv: "cb98809a22599f353341976bb268ca34"
server_key_version: "encryptionkey@0"
I20260812 16:44:42.003255 16278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:42.020607 16278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:42.023026 16278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:42.023200 16278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:42.023463 16278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:42.023923 16358 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 16:44:42.025804 16278 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 16:44:42.025866 16278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 16:44:42.025934 16278 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 16:44:42.026571 16278 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 16:44:42.026628 16278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 16:44:42.026691 16358 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Bootstrap starting.
I20260812 16:44:42.034155 16278 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:43731
I20260812 16:44:42.034202 16541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:43731 every 8 connection(s)
I20260812 16:44:42.034667 16278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:44:42.038300 16358 log.cc:824] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:42.040923 16358 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:42.041229 16358 tablet_bootstrap.cc:492] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Bootstrap complete.
I20260812 16:44:42.042200 16358 ts_tablet_manager.cc:1397] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.008s
I20260812 16:44:42.043430 16358 raft_consensus.cc:348] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:42.043730 16358 raft_consensus.cc:729] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25549ebd98324ac9998e3ad668441bae, State: Initialized, Role: FOLLOWER
I20260812 16:44:42.043879 16358 consensus_queue.cc:260] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } } peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } }
I20260812 16:44:42.044179 16358 ts_tablet_manager.cc:1428] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
I20260812 16:44:42.044818 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 16278
I20260812 16:44:42.045130 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:40035
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:38065
--webserver_port=37207
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553081, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:42.049896 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.035381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:48365)
0812 16:44:42.035581 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.035626 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.036083 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.039086 (+ 3003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.039091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.039437 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:42.039691 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.039697 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.041304 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.041305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.042582 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.042585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.043397 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.043398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.043543 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.044175 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:42.044185 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:42.046021 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:42.048117 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:42.048124 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:42.048127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:42.048466 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:42.048745 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:42.048746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:42.048746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:42.048865 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:42.049251 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:42.049258 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:42.049402 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.049512 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.049694 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":113,"threads_started":1}
I20260812 16:44:42.049908 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.035472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:48365 (local address 127.21.114.126:38065)
0812 16:44:42.038619 (+ 3147us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.038629 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.038669 (+ 40us) server_negotiation.cc:407] Connection header received
0812 16:44:42.038785 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.038790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.038863 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.039021 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:42.039840 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.041185 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.042693 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.043281 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.043408 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.046142 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:42.046146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:42.046146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:42.046159 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:42.048024 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.048570 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.048578 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.048579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.048669 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.048937 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.048938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.048938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.049166 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:42.049262 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.049570 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.049694 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3089,"thread_start_us":94,"threads_started":1}
I20260812 16:44:42.050694 16543 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38065
I20260812 16:44:42.050817 16543 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:42.051021 16543 heartbeater.cc:511] Master 127.21.114.126:38065 requested a full tablet report, sending...
I20260812 16:44:42.051872 16214 ts_manager.cc:194] Registered new tserver with Master: 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731)
I20260812 16:44:42.053210 16214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:48365
I20260812 16:44:42.054152 16543 heartbeater.cc:503] Master 127.21.114.126:38065 was elected leader, sending a full tablet report...
I20260812 16:44:42.057664 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.052634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37284 (local address 127.21.114.65:43731)
0812 16:44:42.053823 (+ 1189us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.053827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.053838 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:44:42.053877 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.053879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.054047 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.054140 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:42.054335 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.055146 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.056798 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.057262 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.057320 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.057355 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.057581 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.057612 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1154,"thread_start_us":70,"threads_started":1}
I20260812 16:44:42.057731 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.052576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43731 (local address 127.0.0.1:37284)
0812 16:44:42.053562 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.053598 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.053678 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.054170 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.054174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.054176 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:42.054238 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.054240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.055235 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.055236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.056712 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.056716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.057357 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.057358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.057455 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.057470 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.057552 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.057624 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":957,"thread_start_us":101,"threads_started":1}
I20260812 16:44:42.058169 16396 tablet_service.cc:1514] Processing DeleteTablet for tablet dd16004bc14143afbb9268220e535dac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:41 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:37284
I20260812 16:44:42.058861 16559 tablet_replica.cc:330] stopping tablet replica
I20260812 16:44:42.058983 16559 raft_consensus.cc:2229] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:44:42.059077 16559 raft_consensus.cc:2258] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:42.059370 16559 ts_tablet_manager.cc:1905] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:44:42.061365 16559 ts_tablet_manager.cc:1918] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:44:42.061481 16559 log.cc:1196] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/dd16004bc14143afbb9268220e535dac
I20260812 16:44:42.061741 16559 ts_tablet_manager.cc:1939] T dd16004bc14143afbb9268220e535dac P 25549ebd98324ac9998e3ad668441bae: Deleting consensus metadata
I20260812 16:44:42.062247 16188 catalog_manager.cc:4841] TS 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731): tablet dd16004bc14143afbb9268220e535dac (table test-table [id=d5ac8f0445e24f2ea2526456933ed5c8]) successfully deleted
W20260812 16:44:42.134634 16554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:42.134871 16554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:42.134896 16554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:42.136070 16554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:42.136114 16554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:42.136173 16554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:44:42.137652 16554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:40035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=37207
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:42.137907 16554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:42.138151 16554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:42.143327 16569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.143311 16568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.143311 16573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:42.143605 16554 server_base.cc:1034] running on GCE node
I20260812 16:44:42.143824 16554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:42.144114 16554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:42.145287 16554 hybrid_clock.cc:648] HybridClock initialized: now 1786553082145249 us; error 52 us; skew 500 ppm
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:42.147825 16554 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:44:42.148263 16554 webserver.cc:460] Webserver started at http://127.21.114.66:37207/ using document root <none> and password file <none>
I20260812 16:44:42.148536 16554 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:42.148681 16554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:42.150074 16554 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:42.150722 16580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.150889 16554 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:44:42.150979 16554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "347bf015f3f443df9f3cbc7cb3036624"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "865177c1a499f11fd9756e4fe049b0d9"
server_key_iv: "1c18ac96817e44915ce00a4823e86f34"
server_key_version: "encryptionkey@0"
I20260812 16:44:42.151388 16554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:42.163959 16554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:42.165925 16554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:42.166038 16554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:42.166235 16554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:42.166512 16554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:42.166543 16554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.166565 16554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:42.166577 16554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.172730 16554 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:40035
I20260812 16:44:42.172852 16788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:40035 every 8 connection(s)
I20260812 16:44:42.173127 16554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:42.181938 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 16554
I20260812 16:44:42.182261 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:39289
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:38065
--webserver_port=46873
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:42.184134 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.173883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:60593 (local address 127.21.114.126:38065)
0812 16:44:42.173962 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.173964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.174185 (+ 221us) server_negotiation.cc:407] Connection header received
0812 16:44:42.174680 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.174681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.174690 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.174747 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:42.175655 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.176436 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.177863 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.178229 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.178320 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.181029 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:42.181030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:42.181031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:42.181039 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:42.182560 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.183016 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.183017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.183017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.183086 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.183364 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.183365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.183365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.183520 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:42.183591 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.183932 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.184040 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:44:42.184553 16793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.173864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:60593)
0812 16:44:42.174056 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.174100 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.174595 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.174802 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.174805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.175385 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:42.175579 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.175584 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.176570 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.176571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.177787 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.177790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.178339 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.178341 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.178493 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.179288 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:42.179297 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:42.180932 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:42.182662 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:42.182669 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:42.182671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:42.182934 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:42.183157 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:42.183158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:42.183158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:42.183292 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:42.183591 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:42.183597 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:42.183731 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.183882 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.184113 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":115,"threads_started":1}
I20260812 16:44:42.185148 16789 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38065
I20260812 16:44:42.185274 16789 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:42.185513 16789 heartbeater.cc:511] Master 127.21.114.126:38065 requested a full tablet report, sending...
I20260812 16:44:42.186004 16214 ts_manager.cc:194] Registered new tserver with Master: 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035)
I20260812 16:44:42.186399 16214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:60593
W20260812 16:44:42.274016 16794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:42.274217 16794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:42.274241 16794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:42.275375 16794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:42.275417 16794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:42.275476 16794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:44:42.277071 16794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:39289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=46873
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:42.277312 16794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:42.277567 16794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:42.282788 16807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.282797 16802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.282836 16801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:42.282994 16794 server_base.cc:1034] running on GCE node
I20260812 16:44:42.283200 16794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:42.283470 16794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:42.284638 16794 hybrid_clock.cc:648] HybridClock initialized: now 1786553082284618 us; error 35 us; skew 500 ppm
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:42.287231 16794 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:44:42.287703 16794 webserver.cc:460] Webserver started at http://127.21.114.67:46873/ using document root <none> and password file <none>
I20260812 16:44:42.287953 16794 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:42.288048 16794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:42.289458 16794 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:42.290059 16818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.290233 16794 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:42.290336 16794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "b6de8c3a35ed4c3384df74f542736306"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "2018e6011aa420c9671af40e40375f0c"
server_key_iv: "c4a056d36b73d295a7ccaddb1140c0b3"
server_key_version: "encryptionkey@0"
I20260812 16:44:42.290673 16794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:42.307969 16794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:42.310469 16794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:42.310631 16794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:42.310871 16794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:42.311221 16794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:42.311272 16794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.311316 16794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:42.311343 16794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.317453 16794 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:39289
I20260812 16:44:42.317516 17052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:39289 every 8 connection(s)
I20260812 16:44:42.317881 16794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:44:42.319310 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 16794
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:42.326997 17060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.319684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39790 (local address 127.21.114.126:38065)
0812 16:44:42.319810 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.319812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.319835 (+ 23us) server_negotiation.cc:407] Connection header received
0812 16:44:42.319926 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.319926 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.319939 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.320004 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:42.320620 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.321322 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.322188 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.322505 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.322577 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.324035 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:42.324036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:42.324036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:42.324043 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:42.325689 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.326092 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.326093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.326094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.326154 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.326404 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.326405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.326406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.326546 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:42.326671 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.326791 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.326889 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":83,"threads_started":1}
I20260812 16:44:42.328579 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.318694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:55607 (local address 127.21.114.126:38065)
0812 16:44:42.318781 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.318783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.318969 (+ 186us) server_negotiation.cc:407] Connection header received
0812 16:44:42.319844 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.319845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.319859 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.319917 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:42.321113 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.321718 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.322942 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.323185 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.323239 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.325433 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:42.325435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:42.325435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:42.325443 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:42.327083 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.327671 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.327672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.327672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.327733 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:42.328008 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:42.328009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:42.328009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:42.328108 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:42.328160 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.328462 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.328521 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 16:44:42.328846 17056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.318664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:55607)
0812 16:44:42.318848 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.318885 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.319567 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.320004 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.320008 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.320736 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:42.321020 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.321026 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.321823 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.321824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.322856 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.322859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.323269 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.323270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.323444 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.323898 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:42.323908 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:42.325337 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:42.327230 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:42.327237 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:42.327240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:42.327584 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:42.327799 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:42.327800 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:42.327800 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:42.327935 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:42.328166 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:42.328171 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:42.328289 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.328448 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.328570 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":107,"threads_started":1}
I20260812 16:44:42.329303 17053 heartbeater.cc:347] Connected to a master server at 127.21.114.126:38065
I20260812 16:44:42.329422 17053 heartbeater.cc:464] Registering TS with master...
I20260812 16:44:42.329600 17053 heartbeater.cc:511] Master 127.21.114.126:38065 requested a full tablet report, sending...
I20260812 16:44:42.329983 16214 ts_manager.cc:194] Registered new tserver with Master: b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289)
I20260812 16:44:42.330343 16214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:55607
I20260812 16:44:42.338668 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:44:42.341651 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.339023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39800 (local address 127.21.114.126:38065)
0812 16:44:42.339082 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.339084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.339210 (+ 126us) server_negotiation.cc:407] Connection header received
0812 16:44:42.339305 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.339305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.339343 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.339416 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:44:42.339531 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.340008 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.340883 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.341073 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.341149 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.341317 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:44:42.341425 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:44:42.341532 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.341550 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.341568 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:44:42.341938 16214 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:39800:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:44:42.343468 16214 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:44:42.345610 16396 tablet_service.cc:1467] Processing CreateTablet for tablet c3cfd690e60c45e8ba030b9dd977e056 (DEFAULT_TABLE table=test-table [id=c7423eb075274d41a775aee74791f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:42.345835 16396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cfd690e60c45e8ba030b9dd977e056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:42.347375 16358 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Bootstrap starting.
I20260812 16:44:42.347714 16358 tablet_bootstrap.cc:654] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:42.348269 16358 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: No bootstrap required, opened a new log
I20260812 16:44:42.348356 16358 ts_tablet_manager.cc:1397] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:42.348492 16358 raft_consensus.cc:348] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.348594 16358 raft_consensus.cc:374] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:42.348649 16358 raft_consensus.cc:729] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25549ebd98324ac9998e3ad668441bae, State: Initialized, Role: FOLLOWER
I20260812 16:44:42.348695 16358 consensus_queue.cc:260] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.348794 16358 ts_tablet_manager.cc:1428] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.349599 17063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.345440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40035 (local address 127.0.0.1:57406)
0812 16:44:42.345580 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.345591 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.345632 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.346103 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.346104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.346106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:42.346142 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.346144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.347232 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.347233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.348272 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.348274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.349342 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.349343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.349409 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.349414 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.349470 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.349518 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":97,"threads_started":1}
I20260812 16:44:42.349721 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.345340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:39289 (local address 127.0.0.1:47586)
0812 16:44:42.345579 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.345591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.345632 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.345857 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.345858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.345860 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:42.345904 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.345906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.347092 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.347093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.348253 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.348256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.349461 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.349462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.349532 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.349536 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.349593 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.349639 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222}
I20260812 16:44:42.349738 17065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.345444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47586 (local address 127.21.114.67:39289)
0812 16:44:42.345657 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.345663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.345674 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:44:42.345715 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.345717 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.345734 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.345852 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:42.345973 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.346980 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.348682 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.349376 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.349445 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.349503 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.349604 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.349651 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":111,"threads_started":1}
I20260812 16:44:42.350001 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.345743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57406 (local address 127.21.114.66:40035)
0812 16:44:42.345945 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.345950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.345960 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:44:42.346002 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.346004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.346020 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.346091 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:42.346197 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.347113 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.348419 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.349161 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.349233 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.349291 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.349501 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.349546 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":91,"threads_started":1}
I20260812 16:44:42.350427 16923 tablet_service.cc:1467] Processing CreateTablet for tablet c3cfd690e60c45e8ba030b9dd977e056 (DEFAULT_TABLE table=test-table [id=c7423eb075274d41a775aee74791f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:42.350646 16668 tablet_service.cc:1467] Processing CreateTablet for tablet c3cfd690e60c45e8ba030b9dd977e056 (DEFAULT_TABLE table=test-table [id=c7423eb075274d41a775aee74791f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:44:42.350793 16923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cfd690e60c45e8ba030b9dd977e056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:42.351009 16668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cfd690e60c45e8ba030b9dd977e056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:42.353698 17072 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Bootstrap starting.
I20260812 16:44:42.353724 17069 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Bootstrap starting.
I20260812 16:44:42.354383 17072 tablet_bootstrap.cc:654] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:42.354435 17069 tablet_bootstrap.cc:654] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:42.354888 17072 log.cc:824] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:42.354969 17069 log.cc:824] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:42.355682 17072 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: No bootstrap required, opened a new log
I20260812 16:44:42.355737 17072 ts_tablet_manager.cc:1397] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:44:42.355775 17069 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: No bootstrap required, opened a new log
I20260812 16:44:42.355844 17069 ts_tablet_manager.cc:1397] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:44:42.357334 17072 raft_consensus.cc:348] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.357491 17072 raft_consensus.cc:374] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:42.357537 17072 raft_consensus.cc:729] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 347bf015f3f443df9f3cbc7cb3036624, State: Initialized, Role: FOLLOWER
I20260812 16:44:42.357441 17069 raft_consensus.cc:348] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.357589 17069 raft_consensus.cc:374] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:42.357635 17069 raft_consensus.cc:729] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6de8c3a35ed4c3384df74f542736306, State: Initialized, Role: FOLLOWER
I20260812 16:44:42.357653 17072 consensus_queue.cc:260] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.357746 17069 consensus_queue.cc:260] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.357937 17072 ts_tablet_manager.cc:1428] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:44:42.357959 16789 heartbeater.cc:503] Master 127.21.114.126:38065 was elected leader, sending a full tablet report...
I20260812 16:44:42.358019 17069 ts_tablet_manager.cc:1428] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:44:42.358139 17053 heartbeater.cc:503] Master 127.21.114.126:38065 was elected leader, sending a full tablet report...
W20260812 16:44:42.423791 16792 tablet.cc:2369] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:44:42.537017 16544 tablet.cc:2369] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:44:42.568599 17054 tablet.cc:2369] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:44:42.600831 17077 raft_consensus.cc:482] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:44:42.600965 17077 raft_consensus.cc:504] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.601325 17077 leader_election.cc:288] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035), 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731)
I20260812 16:44:42.605063 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.601613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:38527 (local address 127.21.114.66:40035)
0812 16:44:42.601660 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.601662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.601673 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:44:42.601748 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.601749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.601759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.601819 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:42.602004 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.602760 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.604231 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.604676 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.604734 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.604741 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.604939 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.604987 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:44:42.605067 17056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.601534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40035 (local address 127.21.114.67:38527)
0812 16:44:42.601596 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.601610 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.601664 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.601835 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.601836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.601839 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:42.601920 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.601922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.602843 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.602844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.604127 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.604130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.604757 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.604759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.604848 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.604852 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.604904 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.604962 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":25}
I20260812 16:44:42.605093 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.601538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43731 (local address 127.21.114.67:58525)
0812 16:44:42.601788 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.601799 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.601884 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:42.602044 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:42.602049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:42.602051 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:44:42.602102 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.602103 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.602927 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.602928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.604127 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:42.604130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.604816 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.604817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:42.604880 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.604884 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:44:42.604962 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 16:44:42.605000 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":46,"thread_start_us":113,"threads_started":1}
I20260812 16:44:42.605106 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.601657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:58525 (local address 127.21.114.65:43731)
0812 16:44:42.601804 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.601806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.601891 (+ 85us) server_negotiation.cc:407] Connection header received
0812 16:44:42.601941 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.601942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.601950 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.602027 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:44:42.602169 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.602853 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.604257 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.604705 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.604801 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.604810 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.604983 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.605032 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260812 16:44:42.605502 16704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cfd690e60c45e8ba030b9dd977e056" candidate_uuid: "b6de8c3a35ed4c3384df74f542736306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "347bf015f3f443df9f3cbc7cb3036624" is_pre_election: true
I20260812 16:44:42.605690 16704 raft_consensus.cc:2454] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6de8c3a35ed4c3384df74f542736306 in term 0.
I20260812 16:44:42.605636 16468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cfd690e60c45e8ba030b9dd977e056" candidate_uuid: "b6de8c3a35ed4c3384df74f542736306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25549ebd98324ac9998e3ad668441bae" is_pre_election: true
I20260812 16:44:42.605810 16468 raft_consensus.cc:2454] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6de8c3a35ed4c3384df74f542736306 in term 0.
I20260812 16:44:42.605990 16820 leader_election.cc:302] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 347bf015f3f443df9f3cbc7cb3036624, b6de8c3a35ed4c3384df74f542736306; no voters:
I20260812 16:44:42.606165 17077 raft_consensus.cc:2781] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:44:42.606205 17077 raft_consensus.cc:482] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:44:42.606220 17077 raft_consensus.cc:3037] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:42.606978 17077 raft_consensus.cc:504] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.607131 17077 leader_election.cc:288] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [CANDIDATE]: Term 1 election: Requested vote from peers 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035), 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731)
I20260812 16:44:42.607273 16468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cfd690e60c45e8ba030b9dd977e056" candidate_uuid: "b6de8c3a35ed4c3384df74f542736306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25549ebd98324ac9998e3ad668441bae"
I20260812 16:44:42.607368 16468 raft_consensus.cc:3037] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:42.608012 16468 raft_consensus.cc:2454] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6de8c3a35ed4c3384df74f542736306 in term 1.
I20260812 16:44:42.608144 16704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cfd690e60c45e8ba030b9dd977e056" candidate_uuid: "b6de8c3a35ed4c3384df74f542736306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "347bf015f3f443df9f3cbc7cb3036624"
I20260812 16:44:42.608210 16824 leader_election.cc:302] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25549ebd98324ac9998e3ad668441bae, b6de8c3a35ed4c3384df74f542736306; no voters:
I20260812 16:44:42.608230 16704 raft_consensus.cc:3037] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:42.608345 17077 raft_consensus.cc:2781] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:42.608503 17077 raft_consensus.cc:686] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 1 LEADER]: Becoming Leader. State: Replica: b6de8c3a35ed4c3384df74f542736306, State: Running, Role: LEADER
I20260812 16:44:42.608605 17077 consensus_queue.cc:237] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.609190 16704 raft_consensus.cc:2454] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6de8c3a35ed4c3384df74f542736306 in term 1.
I20260812 16:44:42.609464 16213 catalog_manager.cc:5495] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6de8c3a35ed4c3384df74f542736306 (127.21.114.67). New cstate: current_term: 1 leader_uuid: "b6de8c3a35ed4c3384df74f542736306" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } health_report { overall_health: UNKNOWN } } }
I20260812 16:44:42.631778 17065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.629404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47600 (local address 127.21.114.67:39289)
0812 16:44:42.629476 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:42.629478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:42.629485 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:44:42.629518 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:42.629519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:42.629536 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:42.629619 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:44:42.629768 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.630256 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.630986 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:42.631183 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:42.631262 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:42.631428 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:44:42.631526 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:44:42.631622 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:42.631642 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 16:44:42.631663 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:44:42.633662 16468 raft_consensus.cc:1261] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Refusing update from remote peer b6de8c3a35ed4c3384df74f542736306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:42.633662 16704 raft_consensus.cc:1261] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Refusing update from remote peer b6de8c3a35ed4c3384df74f542736306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:44:42.634029 17077 consensus_queue.cc:1035] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:42.634205 17083 consensus_queue.cc:1035] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:44:42.639264 16213 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:39800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:44:42.639382 16213 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:39800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:44:42.640162 16213 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Sending DeleteTablet for 3 replicas of tablet c3cfd690e60c45e8ba030b9dd977e056
I20260812 16:44:42.640548 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 16278
I20260812 16:44:42.640583 16923 tablet_service.cc:1514] Processing DeleteTablet for tablet c3cfd690e60c45e8ba030b9dd977e056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:42 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:47586
I20260812 16:44:42.640594 16668 tablet_service.cc:1514] Processing DeleteTablet for tablet c3cfd690e60c45e8ba030b9dd977e056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:44:42 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:57406
I20260812 16:44:42.640779 17105 tablet_replica.cc:330] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: stopping tablet replica
I20260812 16:44:42.640862 17105 raft_consensus.cc:2229] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:44:42.640975 17105 raft_consensus.cc:2258] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:42.646135 17105 ts_tablet_manager.cc:1905] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:44:42.649729 17105 ts_tablet_manager.cc:1918] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:44:42.649827 17105 log.cc:1196] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/c3cfd690e60c45e8ba030b9dd977e056
I20260812 16:44:42.650110 17105 ts_tablet_manager.cc:1939] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Deleting consensus metadata
I20260812 16:44:42.650579 16186 catalog_manager.cc:4841] TS b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289): tablet c3cfd690e60c45e8ba030b9dd977e056 (table test-table [id=c7423eb075274d41a775aee74791f2e2]) successfully deleted
W20260812 16:44:42.658087 16188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:43731 (error 108)
I20260812 16:44:42.658419 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 16554
I20260812 16:44:42.658439 17107 tablet_replica.cc:330] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: stopping tablet replica
I20260812 16:44:42.658560 17107 raft_consensus.cc:2229] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:44:42.658681 17107 raft_consensus.cc:2258] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:44:42.662483 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.658568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43731 (local address 127.0.0.1:55060)
0812 16:44:42.662369 (+ 3801us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.662443 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3775}
W20260812 16:44:42.664579 16188 catalog_manager.cc:4584] TS 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3cfd690e60c45e8ba030b9dd977e056: Network error: Client connection negotiation failed: client connection to 127.21.114.65:43731: connect: Connection refused (error 111)
I20260812 16:44:42.670555 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:42.670422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40035 (local address 127.0.0.1:57414)
0812 16:44:42.670484 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.670518 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.66:40035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 16:44:42.670552 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 16794
I20260812 16:44:42.688733 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 16158
I20260812 16:44:42.708525 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38065
--webserver_interface=127.21.114.126
--webserver_port=40439
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:38065
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:42.791961 17114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:42.792186 17114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:42.792209 17114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:42.793435 17114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:42.793481 17114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:42.793496 17114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:42.793551 17114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:42.793578 17114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:42.795087 17114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:38065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:38065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=40439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:42.795374 17114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:42.795634 17114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:42.800622 17123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:42.800760 17114 server_base.cc:1034] running on GCE node
W20260812 16:44:42.800637 17125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.800804 17122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:42.801148 17114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:42.801465 17114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:42.802632 17114 hybrid_clock.cc:648] HybridClock initialized: now 1786553082802618 us; error 44 us; skew 500 ppm
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:42.805415 17114 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:42.805923 17114 webserver.cc:460] Webserver started at http://127.21.114.126:40439/ using document root <none> and password file <none>
I20260812 16:44:42.806175 17114 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:42.806246 17114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:42.807678 17114 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:44:42.808467 17138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.808687 17114 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:42.808801 17114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "ad0e8be7d4b4d7d953a8c8f31adfcfb7"
server_key_iv: "56e591a7a8e8bb046a195c371b0746bb"
server_key_version: "encryptionkey@0"
I20260812 16:44:42.809181 17114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:42.822872 17114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:42.825006 17114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:42.825191 17114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:42.829638 17114 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:38065
I20260812 16:44:42.829671 17237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:38065 every 8 connection(s)
I20260812 16:44:42.830155 17114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:42.831766 17239 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:44:42.832512 17239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap starting.
I20260812 16:44:42.833855 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 17114
I20260812 16:44:42.834141 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:43731
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:38065
--webserver_port=33983
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:42.841475 17239 log.cc:824] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:42.843812 17239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:42.844135 17239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2: Bootstrap complete.
I20260812 16:44:42.846494 17239 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:42.846750 17239 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb3b95fe28b4ee2a78d55bb0d8efff2, State: Initialized, Role: FOLLOWER
I20260812 16:44:42.846964 17239 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:42.847069 17239 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:42.847122 17239 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:42.847170 17239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 2 FOLLOWER]: Advancing to term 3
I20260812 16:44:42.848222 17239 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:42.848381 17239 leader_election.cc:302] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccb3b95fe28b4ee2a78d55bb0d8efff2; no voters:
I20260812 16:44:42.848587 17239 leader_election.cc:288] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 16:44:42.848626 17246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 16:44:42.848739 17246 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [term 3 LEADER]: Becoming Leader. State: Replica: ccb3b95fe28b4ee2a78d55bb0d8efff2, State: Running, Role: LEADER
I20260812 16:44:42.848886 17239 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:42.848917 17246 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } }
I20260812 16:44:42.849288 17248 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } } }
I20260812 16:44:42.849303 17247 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccb3b95fe28b4ee2a78d55bb0d8efff2. Latest consensus state: current_term: 3 leader_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccb3b95fe28b4ee2a78d55bb0d8efff2" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 38065 } } }
I20260812 16:44:42.849391 17248 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:42.849416 17247 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccb3b95fe28b4ee2a78d55bb0d8efff2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:42.849598 17257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:42.850656 17257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:42.850785 17257 catalog_manager.cc:1259] Loaded cluster ID: 8608156e922144c89cdffad822d1a0fc
I20260812 16:44:42.850881 17257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 16:44:42.851352 17257 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f51b193b9ad google::LogMessage::Fail() at ??:0
@ 0x7f51b193e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f51b193b4de google::LogMessage::Flush() at ??:0
@ 0x7f51b193ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f51b985c0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f51b98658b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f51b38090d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f51b37fe954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f51b46626db start_thread at ??:0
@ 0x7f51b043961f clone at ??:0
W20260812 16:44:42.927785 17244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:42.928054 17244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:42.928084 17244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:42.929324 17244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:42.929358 17244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:42.929384 17244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:44:42.931221 17244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:43731
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=33983
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:42.931425 17244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:42.931687 17244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:42.938320 17288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.938437 17287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:42.938324 17292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:42.939146 17244 server_base.cc:1034] running on GCE node
I20260812 16:44:42.939389 17244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:42.939663 17244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:42.940832 17244 hybrid_clock.cc:648] HybridClock initialized: now 1786553082940801 us; error 48 us; skew 500 ppm
Aug 12 16:44:42 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:42.944195 17244 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:44:42.947402 17244 webserver.cc:460] Webserver started at http://127.21.114.65:33983/ using document root <none> and password file <none>
I20260812 16:44:42.947696 17244 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:42.947752 17244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:42.949754 17244 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:42.950702 17314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:42.950942 17244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:42.951033 17244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "25549ebd98324ac9998e3ad668441bae"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "bb36637a8d77f0cbf602d92a262e81e4"
server_key_iv: "cb98809a22599f353341976bb268ca34"
server_key_version: "encryptionkey@0"
I20260812 16:44:42.951471 17244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:42.965425 17244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:42.968163 17244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:42.968365 17244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:42.968647 17244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:42.969211 17338 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 16:44:42.970733 17244 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 16:44:42.970798 17244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 16:44:42.970839 17244 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 16:44:42.971812 17244 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 16:44:42.971859 17244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 16:44:42.971946 17338 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Bootstrap starting.
I20260812 16:44:42.979984 17244 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:43731
I20260812 16:44:42.980108 17530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:43731 every 8 connection(s)
I20260812 16:44:42.980660 17244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:44:42.982892 17338 log.cc:824] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:42.985239 17338 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:42.985545 17338 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Bootstrap complete.
I20260812 16:44:42.986483 17338 ts_tablet_manager.cc:1397] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260812 16:44:42.987516 17338 raft_consensus.cc:348] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.987775 17338 raft_consensus.cc:729] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25549ebd98324ac9998e3ad668441bae, State: Initialized, Role: FOLLOWER
I20260812 16:44:42.987946 17338 consensus_queue.cc:260] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:42.988209 17338 ts_tablet_manager.cc:1428] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260812 16:44:42.990624 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 17244
I20260812 16:44:42.990913 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:40035
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:38065
--webserver_port=37207
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:43.080469 17542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:43.080729 17542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:43.080771 17542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:43.082019 17542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:43.082091 17542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:43.082136 17542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
W20260812 16:44:43.082827 17537 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:44:42.981399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:58831)
0812 16:44:42.981686 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:42.981758 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:42.982501 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:43.082609 (+100108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":137,"threads_started":1}
W20260812 16:44:43.083137 17531 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:38065 (0 consecutive failures): Network error: Failed to ping master at 127.21.114.126:38065: Client connection negotiation failed: client connection to 127.21.114.126:38065: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 16:44:43.083536 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.083398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:58705)
0812 16:44:43.083456 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.083507 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 16:44:43.083876 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.083781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:49247)
0812 16:44:43.083828 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.083856 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 16:44:43.083998 17531 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 16:44:43.084286 17542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:40035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=37207
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:43.084611 17542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:43.084857 17542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:43.090066 17549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:43.090214 17542 server_base.cc:1034] running on GCE node
W20260812 16:44:43.090047 17556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:43.090107 17548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:43.090572 17542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:43.090831 17542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:43.091977 17542 hybrid_clock.cc:648] HybridClock initialized: now 1786553083091956 us; error 37 us; skew 500 ppm
Aug 12 16:44:43 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553083, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:43.094719 17542 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:44:43.095187 17542 webserver.cc:460] Webserver started at http://127.21.114.66:37207/ using document root <none> and password file <none>
I20260812 16:44:43.095443 17542 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:43.095492 17542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:43.097002 17542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:44:43.097720 17566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:43.097973 17542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:44:43.098142 17542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "347bf015f3f443df9f3cbc7cb3036624"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "865177c1a499f11fd9756e4fe049b0d9"
server_key_iv: "1c18ac96817e44915ce00a4823e86f34"
server_key_version: "encryptionkey@0"
I20260812 16:44:43.098553 17542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:43.111595 17542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:43.113607 17542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:43.113724 17542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:43.113919 17542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:43.114384 17580 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 16:44:43.115913 17542 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 16:44:43.115957 17542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 16:44:43.115983 17542 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 16:44:43.116688 17542 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 16:44:43.116721 17542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 16:44:43.116827 17580 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Bootstrap starting.
I20260812 16:44:43.123941 17542 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:40035
I20260812 16:44:43.124046 17760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:40035 every 8 connection(s)
I20260812 16:44:43.124449 17542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:44:43.125651 17767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.125141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:54821)
0812 16:44:43.125348 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.125446 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
W20260812 16:44:43.125896 17764 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:38065 (0 consecutive failures): Network error: Failed to ping master at 127.21.114.126:38065: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
I20260812 16:44:43.126206 17767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.126107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:34393)
0812 16:44:43.126158 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.126186 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 16:44:43.126499 17767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.126442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:60785)
0812 16:44:43.126467 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.126486 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260812 16:44:43.126627 17764 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 16:44:43.127597 17580 log.cc:824] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:43.128787 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 17542
I20260812 16:44:43.129050 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:39289
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:38065
--webserver_port=46873
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:44:43.129971 17580 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:43.130272 17580 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Bootstrap complete.
I20260812 16:44:43.131565 17580 ts_tablet_manager.cc:1397] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
I20260812 16:44:43.133870 17580 raft_consensus.cc:348] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:43.134302 17580 raft_consensus.cc:729] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 347bf015f3f443df9f3cbc7cb3036624, State: Initialized, Role: FOLLOWER
I20260812 16:44:43.134459 17580 consensus_queue.cc:260] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:43.134759 17580 ts_tablet_manager.cc:1428] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
I20260812 16:44:43.135047 17767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.134915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:42683)
0812 16:44:43.134977 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.135014 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 16:44:43.135375 17767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.135268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:35261)
0812 16:44:43.135314 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.135343 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 16:44:43.217914 17775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:43.218132 17775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:43.218158 17775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:43.219332 17775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:43.219376 17775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:43.219403 17775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:44:43.220902 17775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:39289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=46873
--tserver_master_addrs=127.21.114.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:43.221155 17775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:43.221400 17775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:43.228509 17787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:43.228528 17786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:43.228863 17789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:43.229579 17775 server_base.cc:1034] running on GCE node
I20260812 16:44:43.229825 17775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:43.232595 17775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:43.233762 17775 hybrid_clock.cc:648] HybridClock initialized: now 1786553083233750 us; error 30 us; skew 500 ppm
Aug 12 16:44:43 dist-test-slave-45dx krb5kdc[15153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553083, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:43.236860 17775 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:44:43.237316 17775 webserver.cc:460] Webserver started at http://127.21.114.67:46873/ using document root <none> and password file <none>
I20260812 16:44:43.237571 17775 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:43.237648 17775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:43.239056 17775 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:43.239663 17799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:43.239856 17775 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:44:43.239969 17775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "b6de8c3a35ed4c3384df74f542736306"
format_stamp: "Formatted at 2026-08-12 16:44:41 on dist-test-slave-45dx"
server_key: "2018e6011aa420c9671af40e40375f0c"
server_key_iv: "c4a056d36b73d295a7ccaddb1140c0b3"
server_key_version: "encryptionkey@0"
I20260812 16:44:43.240358 17775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:43.262892 17775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:43.265008 17775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:43.265177 17775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:43.265445 17775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:44:43.265766 17775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:44:43.265822 17775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:43.265868 17775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:44:43.265904 17775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:43.271929 17775 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:39289
I20260812 16:44:43.272010 18006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:39289 every 8 connection(s)
I20260812 16:44:43.272440 17775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:44:43.273593 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.273190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:50935)
0812 16:44:43.273357 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.273448 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
W20260812 16:44:43.274147 18012 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:38065 (0 consecutive failures): Network error: Failed to ping master at 127.21.114.126:38065: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
I20260812 16:44:43.274466 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.274344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:47189)
0812 16:44:43.274411 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.274438 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 16:44:43.274813 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:43.274731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:37455)
0812 16:44:43.274777 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:43.274799 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 16:44:43.274991 18012 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 16:44:43.276237 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 17775
I20260812 16:44:44.084769 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.084517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:45775)
0812 16:44:44.084656 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.084699 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260812 16:44:44.135994 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.135770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:59405)
0812 16:44:44.135913 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.135950 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":59,"threads_started":1}
I20260812 16:44:44.275599 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.275374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:36821)
0812 16:44:44.275497 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.275539 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260812 16:44:44.353792 18024 raft_consensus.cc:482] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:44:44.353983 18024 raft_consensus.cc:504] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:44.354326 18024 leader_election.cc:288] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289), 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035)
Aug 12 16:44:44 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.66@KRBTEST.COM
Aug 12 16:44:44 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553082, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.67@KRBTEST.COM
I20260812 16:44:44.371369 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.354648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:39289 (local address 127.21.114.65:43737)
0812 16:44:44.354730 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.354746 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:44.354818 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:44.355749 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:44.355750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:44.355918 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:44.356064 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:44.356071 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.357782 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.357783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:44.359139 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:44.359143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.360001 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.360002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:44.360174 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:44.365208 (+ 5034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:44.365221 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:44.367765 (+ 2544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:44.369806 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:44.369807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:44.369807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:44.370027 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:44.370291 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:44.370292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:44.370293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:44.370427 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:44.370817 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:44.370825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:44.370966 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 16:44:44.371073 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 16:44:44.371272 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":96}
I20260812 16:44:44.371407 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.354907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:43019 (local address 127.21.114.66:40035)
0812 16:44:44.355056 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:44.355064 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:44.355082 (+ 18us) server_negotiation.cc:407] Connection header received
0812 16:44:44.355185 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:44.355187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:44.355226 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:44.355360 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:44.356187 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.357635 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.359248 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.359898 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.360001 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:44.367595 (+ 7594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:44.367600 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:44.367601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:44.367614 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:44.369537 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:44.370117 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:44.370120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:44.370121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:44.370216 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:44.370500 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:44.370501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:44.370502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:44.370743 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:44.370838 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:44.371132 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 16:44:44.371261 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":52,"threads_started":1}
I20260812 16:44:44.371421 18026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.354768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:43737 (local address 127.21.114.67:39289)
0812 16:44:44.354953 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:44.354967 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:44.355003 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:44:44.355581 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:44.355584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:44.355624 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:44.355764 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:44.356190 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.357635 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.359244 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.359875 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.359998 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:44.367931 (+ 7933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:44.367934 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:44.367935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:44.367946 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:44.369721 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:44.370115 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:44.370119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:44.370119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:44.370217 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:44.370500 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:44.370501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:44.370502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:44.370742 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:44.370837 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:44.371145 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 16:44:44.371290 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260812 16:44:44.371582 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.354788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40035 (local address 127.21.114.65:43019)
0812 16:44:44.354910 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.354919 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:44.354959 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:44.355404 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:44.355407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:44.355791 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:44.356064 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:44.356071 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.357794 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.357795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:44.359139 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:44.359143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:44.359999 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:44.360001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:44.360174 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:44.365208 (+ 5034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:44.365221 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:44.367348 (+ 2127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:44.369626 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:44.369634 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:44.369636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:44.370027 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:44.370293 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:44.370294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:44.370294 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:44.370428 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:44.370820 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:44.370841 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:44.370964 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 16:44:44.371073 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 16:44:44.371356 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":218,"thread_start_us":53,"threads_started":1}
I20260812 16:44:44.372558 17689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cfd690e60c45e8ba030b9dd977e056" candidate_uuid: "25549ebd98324ac9998e3ad668441bae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "347bf015f3f443df9f3cbc7cb3036624" is_pre_election: true
I20260812 16:44:44.372736 17689 raft_consensus.cc:2454] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25549ebd98324ac9998e3ad668441bae in term 1.
W20260812 16:44:44.372911 17329 leader_election.cc:341] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289): Not found: Tablet not found: c3cfd690e60c45e8ba030b9dd977e056
I20260812 16:44:44.373009 17329 leader_election.cc:302] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25549ebd98324ac9998e3ad668441bae, 347bf015f3f443df9f3cbc7cb3036624; no voters: b6de8c3a35ed4c3384df74f542736306
I20260812 16:44:44.373168 18024 raft_consensus.cc:2781] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 16:44:44.373262 18024 raft_consensus.cc:482] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:44:44.373301 18024 raft_consensus.cc:3037] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:44:44.374408 18024 raft_consensus.cc:504] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:44.374555 18024 leader_election.cc:288] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 2 election: Requested vote from peers b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289), 347bf015f3f443df9f3cbc7cb3036624 (127.21.114.66:40035)
I20260812 16:44:44.374755 17689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3cfd690e60c45e8ba030b9dd977e056" candidate_uuid: "25549ebd98324ac9998e3ad668441bae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "347bf015f3f443df9f3cbc7cb3036624"
W20260812 16:44:44.374830 17329 leader_election.cc:341] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289): Not found: Tablet not found: c3cfd690e60c45e8ba030b9dd977e056
I20260812 16:44:44.374843 17689 raft_consensus.cc:3037] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:44:44.375909 17689 raft_consensus.cc:2454] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25549ebd98324ac9998e3ad668441bae in term 2.
I20260812 16:44:44.376111 17329 leader_election.cc:302] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25549ebd98324ac9998e3ad668441bae, 347bf015f3f443df9f3cbc7cb3036624; no voters: b6de8c3a35ed4c3384df74f542736306
I20260812 16:44:44.376204 18024 raft_consensus.cc:2781] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 2 FOLLOWER]: Leader election won for term 2
I20260812 16:44:44.376399 18024 raft_consensus.cc:686] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [term 2 LEADER]: Becoming Leader. State: Replica: 25549ebd98324ac9998e3ad668441bae, State: Running, Role: LEADER
I20260812 16:44:44.376531 18024 consensus_queue.cc:237] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:44.376711 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.376601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:37319)
0812 16:44:44.376651 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.376683 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 16:44:44.882035 17689 raft_consensus.cc:1261] T c3cfd690e60c45e8ba030b9dd977e056 P 347bf015f3f443df9f3cbc7cb3036624 [term 2 FOLLOWER]: Refusing update from remote peer 25549ebd98324ac9998e3ad668441bae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 16:44:44.882436 18038 consensus_queue.cc:1035] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 16:44:44.883450 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.883230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:36391)
0812 16:44:44.883344 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.883400 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":44,"threads_started":1}
W20260812 16:44:44.884383 17329 consensus_peers.cc:487] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae -> Peer b6de8c3a35ed4c3384df74f542736306 (127.21.114.67:39289): Couldn't send request to peer b6de8c3a35ed4c3384df74f542736306. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3cfd690e60c45e8ba030b9dd977e056. This is attempt 1: this message will repeat every 5th retry.
I20260812 16:44:44.884466 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.884357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:38927)
0812 16:44:44.884404 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.884438 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 16:44:44.884487 18050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:44.884270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:38171)
0812 16:44:44.884392 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:44.884422 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":58,"threads_started":1}
I20260812 16:44:45.276345 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.276090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:60257)
0812 16:44:45.276231 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.276269 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260812 16:44:45.447695 18054 ts_tablet_manager.cc:927] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Initiating tablet copy from peer 25549ebd98324ac9998e3ad668441bae (127.21.114.65:43731)
I20260812 16:44:45.447974 18054 tablet_copy_client.cc:316] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: tablet copy: Beginning tablet copy session from remote peer at address 127.21.114.65:43731
Aug 12 16:44:45 dist-test-slave-45dx krb5kdc[15153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553083, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:44:45.456305 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.448278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:43731 (local address 127.21.114.67:56993)
0812 16:44:45.448353 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.448373 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 16:44:45.448450 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:44:45.448706 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:44:45.448714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:44:45.449010 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:44:45.449086 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:45.449088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:45.449973 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:45.449975 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:45.450586 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:44:45.450589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:44:45.451228 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:44:45.451229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:44:45.451338 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:45.451943 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:44:45.451948 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:44:45.453363 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:44:45.455003 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:45.455010 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:45.455012 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:45.455207 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:45.455470 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:44:45.455476 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:44:45.455477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:44:45.455547 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:44:45.455887 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:44:45.455894 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:44:45.455961 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 16:44:45.456056 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 16:44:45.456182 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 16:44:45.456336 18058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.448398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:56993 (local address 127.21.114.65:43731)
0812 16:44:45.448530 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:45.448536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:45.448547 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:44:45.448574 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:45.448576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:45.448589 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:45.448657 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:45.449169 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:45.449870 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:45.450670 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:45.451106 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:45.451198 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:45.453448 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:45.453456 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:45.453457 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:45.453463 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:45.454922 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:45.455287 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:45.455289 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:45.455290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:45.455359 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:45.455631 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:45.455633 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:45.455633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:45.455807 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:45.455910 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:45.456095 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 16:44:45.456206 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260812 16:44:45.456816 17485 tablet_copy_service.cc:140] P 25549ebd98324ac9998e3ad668441bae: Received BeginTabletCopySession request for tablet c3cfd690e60c45e8ba030b9dd977e056 from peer b6de8c3a35ed4c3384df74f542736306 ({username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:56993)
I20260812 16:44:45.456923 17485 tablet_copy_service.cc:161] P 25549ebd98324ac9998e3ad668441bae: Beginning new tablet copy session on tablet c3cfd690e60c45e8ba030b9dd977e056 from peer b6de8c3a35ed4c3384df74f542736306 at {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:56993: session id = b6de8c3a35ed4c3384df74f542736306-c3cfd690e60c45e8ba030b9dd977e056
I20260812 16:44:45.457440 17485 tablet_copy_source_session.cc:205] T c3cfd690e60c45e8ba030b9dd977e056 P 25549ebd98324ac9998e3ad668441bae: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 16:44:45.458432 18054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3cfd690e60c45e8ba030b9dd977e056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:45.461062 18054 tablet_copy_client.cc:791] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: tablet copy: Starting download of 0 data blocks...
I20260812 16:44:45.461210 18054 tablet_copy_client.cc:655] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: tablet copy: Starting download of 1 WAL segments...
I20260812 16:44:45.462049 18054 tablet_copy_client.cc:531] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 16:44:45.462741 18054 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Bootstrap starting.
I20260812 16:44:45.464118 18054 log.cc:824] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:45.466249 18054 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:44:45.466490 18054 tablet_bootstrap.cc:492] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Bootstrap complete.
I20260812 16:44:45.466629 18054 ts_tablet_manager.cc:1397] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260812 16:44:45.467578 18054 raft_consensus.cc:348] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:45.467722 18054 raft_consensus.cc:729] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6de8c3a35ed4c3384df74f542736306, State: Initialized, Role: FOLLOWER
I20260812 16:44:45.467865 18054 consensus_queue.cc:260] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6de8c3a35ed4c3384df74f542736306" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39289 } } peers { permanent_uuid: "347bf015f3f443df9f3cbc7cb3036624" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40035 } } peers { permanent_uuid: "25549ebd98324ac9998e3ad668441bae" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 43731 } }
I20260812 16:44:45.468152 18054 ts_tablet_manager.cc:1428] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306: Time spent starting tablet: real 0.001s user 0.000s sys 0.003s
I20260812 16:44:45.468479 17485 tablet_copy_service.cc:342] P 25549ebd98324ac9998e3ad668441bae: Request end of tablet copy session b6de8c3a35ed4c3384df74f542736306-c3cfd690e60c45e8ba030b9dd977e056 received from {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:56993
I20260812 16:44:45.468531 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.468412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:49077)
0812 16:44:45.468467 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.468502 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 16:44:45.468544 17485 tablet_copy_service.cc:433] P 25549ebd98324ac9998e3ad668441bae: ending tablet copy session b6de8c3a35ed4c3384df74f542736306-c3cfd690e60c45e8ba030b9dd977e056 on tablet c3cfd690e60c45e8ba030b9dd977e056 with peer b6de8c3a35ed4c3384df74f542736306
I20260812 16:44:45.468864 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.468762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:58147)
0812 16:44:45.468797 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.468830 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 16:44:45.885044 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.884823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:35265)
0812 16:44:45.884958 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.884999 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":94,"threads_started":1}
I20260812 16:44:45.885048 18066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.884857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:42207)
0812 16:44:45.884978 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.885007 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260812 16:44:45.959753 18066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.959624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:51307)
0812 16:44:45.959678 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.959710 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 16:44:45.959827 17924 raft_consensus.cc:1203] T c3cfd690e60c45e8ba030b9dd977e056 P b6de8c3a35ed4c3384df74f542736306 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260812 16:44:45.960389 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:45.960199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:57127)
0812 16:44:45.960271 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:45.960354 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 16:44:46.885679 18071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:46.885464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:48591)
0812 16:44:46.885591 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:46.885629 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260812 16:44:46.960448 18076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:46.960169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:56121)
0812 16:44:46.960350 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:46.960401 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260812 16:44:46.961001 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:46.960802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:42473)
0812 16:44:46.960937 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:46.960962 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260812 16:44:47.886348 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:47.886129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:57311)
0812 16:44:47.886268 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:47.886301 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260812 16:44:47.961072 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:47.960861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:60919)
0812 16:44:47.960982 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:47.961022 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260812 16:44:47.961683 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:47.961467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:36343)
0812 16:44:47.961591 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:47.961633 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":49,"threads_started":1}
I20260812 16:44:48.887190 18087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:48.886985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:41669)
0812 16:44:48.887107 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:48.887140 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":60,"threads_started":1}
I20260812 16:44:48.962918 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:48.962178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:34699)
0812 16:44:48.962832 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:48.962863 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":567,"threads_started":1}
I20260812 16:44:48.962918 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:48.961544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:57359)
0812 16:44:48.962823 (+ 1279us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:48.962863 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":1201,"threads_started":1}
I20260812 16:44:48.963375 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:48.963267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:56495)
0812 16:44:48.963314 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:48.963354 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 16:44:49.888005 18090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:49.887780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:46191)
0812 16:44:49.887915 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:49.887954 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260812 16:44:49.963677 18091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:49.963407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:41179)
0812 16:44:49.963541 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:49.963602 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260812 16:44:49.963984 18093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:49.963778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:53035)
0812 16:44:49.963902 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:49.963940 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":52,"threads_started":1}
I20260812 16:44:50.888761 18095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:50.888545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:38259)
0812 16:44:50.888673 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:50.888712 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260812 16:44:50.964522 18096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:50.964177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:35925)
0812 16:44:50.964408 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:50.964452 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":97,"threads_started":1}
I20260812 16:44:50.967163 18099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:50.964433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:45223)
0812 16:44:50.967096 (+ 2663us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:50.967126 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2647,"thread_start_us":2600,"threads_started":1}
I20260812 16:44:51.889509 18103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:51.889272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:45249)
0812 16:44:51.889423 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:51.889459 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260812 16:44:51.965237 18105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:51.965008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:44705)
0812 16:44:51.965146 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:51.965183 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260812 16:44:51.967721 18107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:51.967552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:47343)
0812 16:44:51.967658 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:51.967681 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260812 16:44:52.890344 18109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:52.890037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:52357)
0812 16:44:52.890250 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:52.890291 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":72,"threads_started":1}
I20260812 16:44:52.965948 18112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:52.965720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:51329)
0812 16:44:52.965856 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:52.965896 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260812 16:44:52.968425 18113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:52.968172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:42747)
0812 16:44:52.968280 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:52.968374 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":52,"threads_started":1}
I20260812 16:44:53.891079 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:53.890857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:58343)
0812 16:44:53.890990 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:53.891029 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260812 16:44:53.966724 18116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:53.966488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:58345)
0812 16:44:53.966629 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:53.966673 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260812 16:44:53.969045 18118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:53.968854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:53627)
0812 16:44:53.968964 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:53.969001 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260812 16:44:54.891969 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:54.891699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:47397)
0812 16:44:54.891860 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:54.891915 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260812 16:44:54.967640 18121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:54.967357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:34789)
0812 16:44:54.967522 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:54.967580 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260812 16:44:54.969722 18122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:54.969490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:56079)
0812 16:44:54.969645 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:54.969682 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260812 16:44:55.892813 18123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:55.892588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:46691)
0812 16:44:55.892717 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:55.892758 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260812 16:44:55.968446 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:55.968137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:38667)
0812 16:44:55.968341 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:55.968392 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":71,"threads_started":1}
I20260812 16:44:55.970363 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:55.970163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:35763)
0812 16:44:55.970289 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:55.970325 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":72,"threads_started":1}
I20260812 16:44:56.893512 18129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:56.893260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:53583)
0812 16:44:56.893418 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:56.893460 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260812 16:44:56.969265 18130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:56.969023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:58969)
0812 16:44:56.969165 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:56.969211 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260812 16:44:56.971275 18131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:56.971023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:49463)
0812 16:44:56.971196 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:56.971232 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":114,"threads_started":1}
I20260812 16:44:57.894316 18133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:57.894048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.66:47383)
0812 16:44:57.894214 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:57.894255 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
I20260812 16:44:57.970078 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:57.969813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.67:42363)
0812 16:44:57.969981 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:57.970025 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260812 16:44:57.971961 18136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:57.971763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:38065 (local address 127.21.114.65:49743)
0812 16:44:57.971881 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 16:44:57.971907 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:38065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260812 16:44:58.282662 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 17244
I20260812 16:44:58.301988 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 17542
I20260812 16:44:58.312162 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 17775
2026-08-12T16:44:58Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18846 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:44:58 dist-test-slave-45dx krb5kdc[18142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:44:58 dist-test-slave-45dx krb5kdc[18142](info): set up 2 sockets
Aug 12 16:44:58 dist-test-slave-45dx krb5kdc[18142](info): commencing operation
krb5kdc: starting...
W20260812 16:44:59.646239 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.295s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:44:59 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:44:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:44:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:44:59.772199 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35157
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:44:59.856671 18167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:44:59.856923 18167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:44:59.856972 18167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:44:59.858162 18167 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 16:44:59.858225 18167 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 16:44:59.858247 18167 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 16:44:59.858268 18167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:44:59.858295 18167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:44:59.858325 18167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:44:59.858347 18167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:44:59.858378 18167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:44:59.859911 18167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:44:59.860208 18167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:44:59.860468 18167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:44:59.865276 18177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:59.865401 18180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:44:59.865293 18176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:44:59.865798 18167 server_base.cc:1034] running on GCE node
I20260812 16:44:59.866039 18167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:44:59.866279 18167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:44:59.867421 18167 hybrid_clock.cc:648] HybridClock initialized: now 1786553099867408 us; error 29 us; skew 500 ppm
Aug 12 16:44:59 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553099, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:44:59.869984 18167 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:44:59.870430 18167 webserver.cc:460] Webserver started at http://127.21.114.126:36963/ using document root <none> and password file <none>
I20260812 16:44:59.870671 18167 fs_manager.cc:359] Metadata directory not provided
I20260812 16:44:59.870736 18167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:44:59.870887 18167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:44:59.871984 18167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "b841e7bbd30f428a8b7af0b440872d1e"
format_stamp: "Formatted at 2026-08-12 16:44:59 on dist-test-slave-45dx"
server_key: "9e254417da790ace1ff999025dd7ab1d"
server_key_iv: "2014c0c75efe8d4702a61452cfdae91b"
server_key_version: "encryptionkey@0"
I20260812 16:44:59.872421 18167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "b841e7bbd30f428a8b7af0b440872d1e"
format_stamp: "Formatted at 2026-08-12 16:44:59 on dist-test-slave-45dx"
server_key: "9e254417da790ace1ff999025dd7ab1d"
server_key_iv: "2014c0c75efe8d4702a61452cfdae91b"
server_key_version: "encryptionkey@0"
I20260812 16:44:59.873800 18167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:59.874606 18194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:44:59.874804 18167 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:44:59.874912 18167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b841e7bbd30f428a8b7af0b440872d1e"
format_stamp: "Formatted at 2026-08-12 16:44:59 on dist-test-slave-45dx"
server_key: "9e254417da790ace1ff999025dd7ab1d"
server_key_iv: "2014c0c75efe8d4702a61452cfdae91b"
server_key_version: "encryptionkey@0"
I20260812 16:44:59.875010 18167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:44:59.883953 18167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:44:59.885825 18167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:44:59.885987 18167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:44:59.890187 18167 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:35157
I20260812 16:44:59.890223 18298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:35157 every 8 connection(s)
I20260812 16:44:59.890568 18167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:44:59.891444 18299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:44:59.893901 18299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap starting.
I20260812 16:44:59.894508 18299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Neither blocks nor log segments found. Creating new log.
I20260812 16:44:59.894824 18299 log.cc:824] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:44:59.895514 18299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: No bootstrap required, opened a new log
I20260812 16:44:59.897172 18299 raft_consensus.cc:348] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:44:59.897316 18299 raft_consensus.cc:374] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:44:59.897341 18299 raft_consensus.cc:729] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841e7bbd30f428a8b7af0b440872d1e, State: Initialized, Role: FOLLOWER
I20260812 16:44:59.897506 18299 consensus_queue.cc:260] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:44:59.897614 18299 raft_consensus.cc:388] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:44:59.897652 18299 raft_consensus.cc:482] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:44:59.897710 18299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:44:59.897737 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 18167
I20260812 16:44:59.897843 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:44:59.898046 21961 external_mini_cluster.cc:1428] Setting key b40f6e3df05320e435d3b32877fd8137
I20260812 16:44:59.898469 18299 raft_consensus.cc:504] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:44:59.898648 18299 leader_election.cc:302] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b841e7bbd30f428a8b7af0b440872d1e; no voters:
I20260812 16:44:59.898845 18299 leader_election.cc:288] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:44:59.899068 18305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:44:59.899147 18299 sys_catalog.cc:564] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:44:59.899220 18305 raft_consensus.cc:686] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 LEADER]: Becoming Leader. State: Replica: b841e7bbd30f428a8b7af0b440872d1e, State: Running, Role: LEADER
I20260812 16:44:59.899327 18305 consensus_queue.cc:237] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:44:59.899791 18307 sys_catalog.cc:455] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b841e7bbd30f428a8b7af0b440872d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } } }
I20260812 16:44:59.899878 18307 sys_catalog.cc:458] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:59.900096 18308 sys_catalog.cc:455] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b841e7bbd30f428a8b7af0b440872d1e. Latest consensus state: current_term: 1 leader_uuid: "b841e7bbd30f428a8b7af0b440872d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } } }
I20260812 16:44:59.900132 18328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:44:59.900164 18308 sys_catalog.cc:458] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: This master's current role is: LEADER
I20260812 16:44:59.900669 18328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:44:59.902220 18328 catalog_manager.cc:1347] Generated new cluster ID: 0c4af13d00c54133b698f269c3277edd
I20260812 16:44:59.902288 18328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:44:59 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:44:59.909936 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:44:59.898543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41726 (local address 127.21.114.126:35157)
0812 16:44:59.898728 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 16:44:59.898738 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:44:59.898774 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:44:59.898901 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:44:59.898908 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:44:59.898972 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:44:59.900319 (+ 1347us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:44:59.900460 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:59.901710 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:59.902697 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:44:59.903105 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:44:59.903233 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:44:59.906084 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:44:59.906089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:44:59.906089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:44:59.906101 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:44:59.908085 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:59.908676 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:59.908679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:59.908679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:59.908800 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:44:59.909024 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:44:59.909025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:44:59.909025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:44:59.909330 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:44:59.909464 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 16:44:59.909608 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 16:44:59.909739 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260812 16:44:59.912895 18328 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:44:59.913393 18328 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:44:59.919651 18328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Generated new TSK 0
I20260812 16:44:59.919840 18328 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:44:59.948686 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35157
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:00.034183 18346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:00.034436 18346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:00.034487 18346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:00.035681 18346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:00.035748 18346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:00.035792 18346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:45:00.037424 18346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:00.037727 18346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:00.037976 18346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:00.043098 18352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:00.043124 18346 server_base.cc:1034] running on GCE node
W20260812 16:45:00.043107 18355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:00.043120 18357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:00.043617 18346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:00.043865 18346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:00.045004 18346 hybrid_clock.cc:648] HybridClock initialized: now 1786553100044990 us; error 29 us; skew 500 ppm
Aug 12 16:45:00 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553100, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:00.047571 18346 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:45:00.048033 18346 webserver.cc:460] Webserver started at http://127.21.114.65:33015/ using document root <none> and password file <none>
I20260812 16:45:00.048281 18346 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:00.048377 18346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:00.048528 18346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:00.049589 18346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d379d0cede684b58215d29a4bea91e96"
server_key_iv: "11b8dff01548f7ab0369f0f0ad0f318a"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.049975 18346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d379d0cede684b58215d29a4bea91e96"
server_key_iv: "11b8dff01548f7ab0369f0f0ad0f318a"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.051330 18346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:45:00.052047 18367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.052218 18346 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:00.052340 18346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d379d0cede684b58215d29a4bea91e96"
server_key_iv: "11b8dff01548f7ab0369f0f0ad0f318a"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.052424 18346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:00.069948 18346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:00.072036 18346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:00.072201 18346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:00.072482 18346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:00.072816 18346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:00.072870 18346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.072921 18346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:00.072947 18346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.078998 18346 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:45203
I20260812 16:45:00.079077 18583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:45203 every 8 connection(s)
I20260812 16:45:00.079427 18346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:45:00.084968 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 18346
I20260812 16:45:00.085098 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:45:00.085361 21961 external_mini_cluster.cc:1428] Setting key f953fae4f44261720b77038e948334bc
Aug 12 16:45:00 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553100, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:00.089533 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.080178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:45393 (local address 127.21.114.126:35157)
0812 16:45:00.080229 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.080231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.080472 (+ 241us) server_negotiation.cc:407] Connection header received
0812 16:45:00.081003 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.081005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.081020 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.081087 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:00.082149 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.082670 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.083724 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.083939 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.084013 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.086614 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:00.086616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:00.086616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:00.086628 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:00.088053 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.088540 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.088542 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.088546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.088602 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.088857 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.088858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.088858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.088977 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:00.089051 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.089383 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.089465 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:45:00.089813 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.080138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:45393)
0812 16:45:00.080324 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.080369 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.080878 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.081167 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.081171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.081828 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:00.082035 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.082040 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.082795 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.082795 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.083628 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.083630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.084031 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.084031 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.084135 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.084640 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:00.084649 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:00.086512 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:00.088137 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:00.088146 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:00.088148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:00.088457 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:00.088667 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:00.088668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:00.088668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:00.088785 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:00.089042 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:00.089050 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:00.089223 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.089330 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.089529 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260812 16:45:00.090380 18585 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35157
I20260812 16:45:00.090488 18585 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:00.090687 18585 heartbeater.cc:511] Master 127.21.114.126:35157 requested a full tablet report, sending...
I20260812 16:45:00.091279 18225 ts_manager.cc:194] Registered new tserver with Master: 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203)
I20260812 16:45:00.091884 18225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:45393
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:45:00.112687 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35157
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:00.195273 18597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:00.195500 18597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:00.195539 18597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:00.196738 18597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:00.196800 18597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:00.196847 18597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:45:00.198386 18597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:00.198657 18597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:00.198887 18597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:00.204324 18611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:00.204365 18597 server_base.cc:1034] running on GCE node
W20260812 16:45:00.204346 18607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:00.204355 18609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:00.204743 18597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:00.205014 18597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:00.206182 18597 hybrid_clock.cc:648] HybridClock initialized: now 1786553100206167 us; error 42 us; skew 500 ppm
Aug 12 16:45:00 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553100, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:00.208710 18597 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:45:00.209182 18597 webserver.cc:460] Webserver started at http://127.21.114.66:34319/ using document root <none> and password file <none>
I20260812 16:45:00.209429 18597 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:00.209503 18597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:00.209652 18597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:00.210695 18597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "44926fa259a4489c9f55d5807c8215a7"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d118b2cc7201af33cd231b023e9daf85"
server_key_iv: "e622118c0dc3e486dfed28bd071d4043"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.211056 18597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "44926fa259a4489c9f55d5807c8215a7"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d118b2cc7201af33cd231b023e9daf85"
server_key_iv: "e622118c0dc3e486dfed28bd071d4043"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.212427 18597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:45:00.213179 18624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.213346 18597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:00.213444 18597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "44926fa259a4489c9f55d5807c8215a7"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d118b2cc7201af33cd231b023e9daf85"
server_key_iv: "e622118c0dc3e486dfed28bd071d4043"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.213552 18597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:00.227514 18597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:00.229614 18597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:00.229779 18597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:00.230014 18597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:00.230350 18597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:00.230403 18597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.230439 18597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:00.230466 18597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.236512 18597 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:37803
I20260812 16:45:00.236564 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:37803 every 8 connection(s)
I20260812 16:45:00.236907 18597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:45:00.238255 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 18597
I20260812 16:45:00.238395 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:45:00.238629 21961 external_mini_cluster.cc:1428] Setting key fb3298e6582b8519e709312814b785af
Aug 12 16:45:00 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553100, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
I20260812 16:45:00.251570 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.237624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:44861 (local address 127.21.114.126:35157)
0812 16:45:00.237756 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.237758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.237977 (+ 219us) server_negotiation.cc:407] Connection header received
0812 16:45:00.238522 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.238524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.238539 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.238617 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:00.239840 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.240626 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.241618 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.241855 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.241971 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.244545 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:00.244547 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:00.244547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:00.244557 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:00.249277 (+ 4720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.250102 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.250104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.250104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.250206 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.250555 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.250556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.250557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.250717 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:00.250809 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.251237 (+ 428us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.251391 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 16:45:00.251652 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.237606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:44861)
0812 16:45:00.237863 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.237901 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.238398 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.238675 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.238678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.239517 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:00.239749 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.239755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.240714 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.240715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.241521 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.241523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.241984 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.241985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.242123 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.242657 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:00.242666 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:00.244438 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:00.249591 (+ 5153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:00.249601 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:00.249604 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:00.250011 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:00.250289 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:00.250290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:00.250290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:00.250471 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:00.250808 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:00.250817 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:00.251026 (+ 209us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.251201 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.251392 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
I20260812 16:45:00.254693 18865 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35157
I20260812 16:45:00.254815 18865 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:00.255043 18865 heartbeater.cc:511] Master 127.21.114.126:35157 requested a full tablet report, sending...
I20260812 16:45:00.255483 18225 ts_manager.cc:194] Registered new tserver with Master: 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803)
I20260812 16:45:00.256059 18225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:44861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:45:00.269172 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35157
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:00.352825 18872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:00.353036 18872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:00.353060 18872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:00.354190 18872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:00.354242 18872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:00.354269 18872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:45:00.355749 18872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:00.356002 18872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:00.356230 18872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:00.361209 18883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:00.361199 18893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:00.361203 18879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:00.361464 18872 server_base.cc:1034] running on GCE node
I20260812 16:45:00.361660 18872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:00.361879 18872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:00.363016 18872 hybrid_clock.cc:648] HybridClock initialized: now 1786553100362994 us; error 44 us; skew 500 ppm
Aug 12 16:45:00 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553100, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:00.365557 18872 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:45:00.366017 18872 webserver.cc:460] Webserver started at http://127.21.114.67:44109/ using document root <none> and password file <none>
I20260812 16:45:00.366250 18872 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:00.366315 18872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:00.366468 18872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:00.367501 18872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "77477620e7f34338bb5816355a97d845"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d8cde8298f2a58883ec84accdd83be57"
server_key_iv: "abd7c88da77b0b8dd0ab0dde49015f29"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.367867 18872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "77477620e7f34338bb5816355a97d845"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d8cde8298f2a58883ec84accdd83be57"
server_key_iv: "abd7c88da77b0b8dd0ab0dde49015f29"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.369279 18872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:45:00.369979 18905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.370146 18872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.370249 18872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "77477620e7f34338bb5816355a97d845"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d8cde8298f2a58883ec84accdd83be57"
server_key_iv: "abd7c88da77b0b8dd0ab0dde49015f29"
server_key_version: "encryptionkey@0"
I20260812 16:45:00.370318 18872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:00.394670 18872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:00.396775 18872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:00.396935 18872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:00.397172 18872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:00.397491 18872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:00.397545 18872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.397590 18872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:00.397617 18872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:00.403811 18872 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:38835
I20260812 16:45:00.403856 19145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:38835 every 8 connection(s)
I20260812 16:45:00.404166 18872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:45:00.405001 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 18872
I20260812 16:45:00.405112 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:45:00.405301 21961 external_mini_cluster.cc:1428] Setting key f2e7c203a50072a214e260e6f7a9947d
Aug 12 16:45:00 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553100, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:00.413293 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.404898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:47981 (local address 127.21.114.126:35157)
0812 16:45:00.404949 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.404951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.405239 (+ 288us) server_negotiation.cc:407] Connection header received
0812 16:45:00.405923 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.405925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.405936 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.406004 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:00.407004 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.407495 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.408511 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.408696 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.408746 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.410959 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:00.410960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:00.410961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:00.410966 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:00.412123 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.412552 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.412553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.412554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.412607 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.412823 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.412824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.412824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.412916 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:00.412961 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.413173 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.413232 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:45:00.413486 19149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.404913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:47981)
0812 16:45:00.405098 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.405149 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.405826 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.406060 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.406063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.406720 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:00.406909 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.406922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.407572 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.407572 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.408432 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.408434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.408760 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.408761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.408866 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.409373 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:00.409382 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:00.410873 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:00.412191 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:00.412197 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:00.412199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:00.412495 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:00.412664 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:00.412665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:00.412665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:00.412775 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:00.412963 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:00.412967 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:00.413077 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.413160 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.413275 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260812 16:45:00.413962 19146 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35157
I20260812 16:45:00.414052 19146 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:00.414187 19146 heartbeater.cc:511] Master 127.21.114.126:35157 requested a full tablet report, sending...
I20260812 16:45:00.414533 18225 ts_manager.cc:194] Registered new tserver with Master: 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
I20260812 16:45:00.414865 18225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:47981
I20260812 16:45:00.416970 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:45:00.424065 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.418305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41734 (local address 127.21.114.126:35157)
0812 16:45:00.418371 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.418373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.418458 (+ 85us) server_negotiation.cc:407] Connection header received
0812 16:45:00.418503 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.418504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.418512 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.418568 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:00.419074 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.419575 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.420404 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.420608 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.420690 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.421761 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:00.421763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:00.421763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:00.421771 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:00.422886 (+ 1115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.423241 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.423242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.423242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.423299 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:00.423512 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:00.423513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:00.423513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:00.423660 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:00.423766 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.423878 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.423965 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 16:45:00.425446 18225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41734:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:45:00.426930 18225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:45:00.433550 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.429471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48470 (local address 127.21.114.66:37803)
0812 16:45:00.429637 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.429641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.429652 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:45:00.429695 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.429696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.429710 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.430046 (+ 336us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:00.430129 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.431195 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.432616 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.433097 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.433189 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.433253 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.433409 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.433453 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260812 16:45:00.433575 19168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.429130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38835 (local address 127.0.0.1:36174)
0812 16:45:00.429277 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.429319 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.429433 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.429867 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.429868 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.429870 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:00.429933 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.429935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.431294 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.431295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.432500 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.432502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.433349 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.433350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.433410 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.433414 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.433443 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.433489 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":47,"threads_started":1}
I20260812 16:45:00.433674 19178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.429241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.21.114.65:45203)
0812 16:45:00.429482 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.429487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.429608 (+ 121us) server_negotiation.cc:407] Connection header received
0812 16:45:00.430056 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.430059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.430076 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.430128 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:00.430313 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.431005 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.432392 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.433123 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.433198 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.433254 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.433547 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.433594 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":95,"threads_started":1}
I20260812 16:45:00.433550 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.429345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:37803 (local address 127.0.0.1:48470)
0812 16:45:00.429577 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.429585 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.429623 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.429835 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.429838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.429841 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:00.429910 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.429912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.431406 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.431406 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.432494 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.432497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.433189 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.433190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.433281 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.433300 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.433377 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.433442 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":78,"threads_started":1}
I20260812 16:45:00.433825 19170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.429198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36174 (local address 127.21.114.67:38835)
0812 16:45:00.429698 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.429701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.429709 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:45:00.429750 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.429751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.429763 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.429867 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:00.430026 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.431178 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.432584 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.433261 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.433615 (+ 354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.433677 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.433702 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.433744 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":70,"threads_started":1}
I20260812 16:45:00.434170 19169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.429131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45203 (local address 127.0.0.1:43984)
0812 16:45:00.429537 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.429548 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.429942 (+ 394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.430214 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.430215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.430217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:00.430246 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.430247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.431125 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.431126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.432282 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.432285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.433294 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.433295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.433364 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.433368 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.433414 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.433462 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":62,"thread_start_us":97,"threads_started":1}
I20260812 16:45:00.434557 19018 tablet_service.cc:1467] Processing CreateTablet for tablet e0ea896349bd4207aaf6c293b6502681 (DEFAULT_TABLE table=test-table [id=8ff203a8f7034dd289e81fa13ef8387d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:00.434657 18715 tablet_service.cc:1467] Processing CreateTablet for tablet e0ea896349bd4207aaf6c293b6502681 (DEFAULT_TABLE table=test-table [id=8ff203a8f7034dd289e81fa13ef8387d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:00.434791 18451 tablet_service.cc:1467] Processing CreateTablet for tablet e0ea896349bd4207aaf6c293b6502681 (DEFAULT_TABLE table=test-table [id=8ff203a8f7034dd289e81fa13ef8387d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:00.434926 19018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ea896349bd4207aaf6c293b6502681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:00.434938 18715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ea896349bd4207aaf6c293b6502681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:00.435045 18451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0ea896349bd4207aaf6c293b6502681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:00.437678 19185 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap starting.
I20260812 16:45:00.438297 19189 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Bootstrap starting.
I20260812 16:45:00.438584 19185 tablet_bootstrap.cc:654] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:00.438604 19190 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Bootstrap starting.
I20260812 16:45:00.439002 19189 tablet_bootstrap.cc:654] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:00.439205 19190 tablet_bootstrap.cc:654] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:00.439231 19185 log.cc:824] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:00.439550 19189 log.cc:824] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:00.439786 19190 log.cc:824] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:00.440222 19185 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: No bootstrap required, opened a new log
I20260812 16:45:00.440331 19185 ts_tablet_manager.cc:1397] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:45:00.440372 19189 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: No bootstrap required, opened a new log
I20260812 16:45:00.440464 19189 ts_tablet_manager.cc:1397] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:45:00.440593 19190 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: No bootstrap required, opened a new log
I20260812 16:45:00.440657 19190 ts_tablet_manager.cc:1397] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:45:00.441897 19185 raft_consensus.cc:348] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.442065 19185 raft_consensus.cc:374] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:00.442109 19185 raft_consensus.cc:729] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703c58f8cf14b8384d99bdcbc6e0cfd, State: Initialized, Role: FOLLOWER
I20260812 16:45:00.442217 19185 consensus_queue.cc:260] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.442502 19185 ts_tablet_manager.cc:1428] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:45:00.442458 19189 raft_consensus.cc:348] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.442638 19189 raft_consensus.cc:374] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:00.442674 19189 raft_consensus.cc:729] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77477620e7f34338bb5816355a97d845, State: Initialized, Role: FOLLOWER
I20260812 16:45:00.442585 19190 raft_consensus.cc:348] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.442737 19190 raft_consensus.cc:374] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:00.442752 18585 heartbeater.cc:503] Master 127.21.114.126:35157 was elected leader, sending a full tablet report...
I20260812 16:45:00.442788 19190 raft_consensus.cc:729] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44926fa259a4489c9f55d5807c8215a7, State: Initialized, Role: FOLLOWER
I20260812 16:45:00.442811 19189 consensus_queue.cc:260] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.442896 19190 consensus_queue.cc:260] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.443097 19189 ts_tablet_manager.cc:1428] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:45:00.443207 19146 heartbeater.cc:503] Master 127.21.114.126:35157 was elected leader, sending a full tablet report...
I20260812 16:45:00.443408 19190 ts_tablet_manager.cc:1428] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:45:00.443529 18865 heartbeater.cc:503] Master 127.21.114.126:35157 was elected leader, sending a full tablet report...
I20260812 16:45:00.445153 19201 raft_consensus.cc:482] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:00.445218 19201 raft_consensus.cc:504] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.445482 19201 leader_election.cc:288] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835), 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203)
I20260812 16:45:00.448458 19170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.445705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:45003 (local address 127.21.114.67:38835)
0812 16:45:00.445740 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.445742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.445750 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:45:00.445774 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.445775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.445786 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.445843 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:00.446004 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.446525 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.447647 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.448091 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.448147 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.448153 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.448345 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.448381 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:45:00.448454 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.445596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38835 (local address 127.21.114.66:45003)
0812 16:45:00.445636 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.445648 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.445694 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.445859 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.445859 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.445861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:00.445932 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.445934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.446599 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.446600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.447574 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.447577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.448165 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.448166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.448251 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.448256 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.448337 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.448386 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":28}
I20260812 16:45:00.448640 19178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.445657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:54781 (local address 127.21.114.65:45203)
0812 16:45:00.445695 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.445697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.445835 (+ 138us) server_negotiation.cc:407] Connection header received
0812 16:45:00.445884 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.445885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.445896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.445960 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:00.446147 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.446600 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.447798 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.448224 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.448333 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.448343 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.448518 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.448562 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:45:00.448818 19058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ea896349bd4207aaf6c293b6502681" candidate_uuid: "44926fa259a4489c9f55d5807c8215a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77477620e7f34338bb5816355a97d845" is_pre_election: true
I20260812 16:45:00.448949 19058 raft_consensus.cc:2454] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44926fa259a4489c9f55d5807c8215a7 in term 0.
I20260812 16:45:00.448922 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.445614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45203 (local address 127.21.114.66:54781)
0812 16:45:00.445756 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.445768 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:00.445830 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:00.445997 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:00.445998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:00.445999 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:00.446065 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.446067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.446678 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.446678 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.447719 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:00.447722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.448364 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.448365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:00.448435 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.448439 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:45:00.448501 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 16:45:00.448854 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260812 16:45:00.449162 18630 leader_election.cc:302] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845; no voters:
I20260812 16:45:00.449290 19201 raft_consensus.cc:2781] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:45:00.449349 19201 raft_consensus.cc:482] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:45:00.449384 19201 raft_consensus.cc:3037] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:00.449321 18492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ea896349bd4207aaf6c293b6502681" candidate_uuid: "44926fa259a4489c9f55d5807c8215a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" is_pre_election: true
I20260812 16:45:00.449463 18492 raft_consensus.cc:2454] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44926fa259a4489c9f55d5807c8215a7 in term 0.
I20260812 16:45:00.450115 19201 raft_consensus.cc:504] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.450265 19201 leader_election.cc:288] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [CANDIDATE]: Term 1 election: Requested vote from peers 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835), 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203)
I20260812 16:45:00.450380 19058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ea896349bd4207aaf6c293b6502681" candidate_uuid: "44926fa259a4489c9f55d5807c8215a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77477620e7f34338bb5816355a97d845"
I20260812 16:45:00.450423 18492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0ea896349bd4207aaf6c293b6502681" candidate_uuid: "44926fa259a4489c9f55d5807c8215a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
I20260812 16:45:00.450471 19058 raft_consensus.cc:3037] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:00.450492 18492 raft_consensus.cc:3037] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:00.451316 18492 raft_consensus.cc:2454] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44926fa259a4489c9f55d5807c8215a7 in term 1.
I20260812 16:45:00.451316 19058 raft_consensus.cc:2454] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44926fa259a4489c9f55d5807c8215a7 in term 1.
I20260812 16:45:00.451471 18630 leader_election.cc:302] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845; no voters:
I20260812 16:45:00.451561 19201 raft_consensus.cc:2781] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:45:00.451705 19201 raft_consensus.cc:686] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 1 LEADER]: Becoming Leader. State: Replica: 44926fa259a4489c9f55d5807c8215a7, State: Running, Role: LEADER
I20260812 16:45:00.451802 19201 consensus_queue.cc:237] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:00.452600 18225 catalog_manager.cc:5495] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "44926fa259a4489c9f55d5807c8215a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } health_report { overall_health: HEALTHY } } }
I20260812 16:45:00.462894 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.460495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48478 (local address 127.21.114.66:37803)
0812 16:45:00.460544 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:00.460546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:00.460558 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:45:00.460594 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:00.460595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:00.460612 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:00.460690 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:45:00.460836 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.461289 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.462066 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:00.462327 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:00.462403 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:00.462568 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:45:00.462672 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:45:00.462753 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:00.462795 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 16:45:00.462815 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:45:00.464543 18492 raft_consensus.cc:1261] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Refusing update from remote peer 44926fa259a4489c9f55d5807c8215a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:45:00.464541 19058 raft_consensus.cc:1261] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Refusing update from remote peer 44926fa259a4489c9f55d5807c8215a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:45:00.464861 19201 consensus_queue.cc:1035] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:45:00.465022 19203 consensus_queue.cc:1035] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:45:00.467552 19219 mvcc.cc:205] Tried to move back new op lower bound from 7317721499500367872 to 7317721499451252736. Current Snapshot: MvccSnapshot[applied={T|T < 7317721499500367872}]
I20260812 16:45:00.469800 18224 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:45:00.469903 18224 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:45:00.470640 18224 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Sending DeleteTablet for 3 replicas of tablet e0ea896349bd4207aaf6c293b6502681
I20260812 16:45:00.470988 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 18346
I20260812 16:45:00.470981 19018 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ea896349bd4207aaf6c293b6502681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:00 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:36174
I20260812 16:45:00.471120 18451 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ea896349bd4207aaf6c293b6502681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:00 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:43984
I20260812 16:45:00.471231 19239 tablet_replica.cc:330] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: stopping tablet replica
I20260812 16:45:00.471323 19239 raft_consensus.cc:2229] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:45:00.471426 19239 raft_consensus.cc:2258] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:00.474128 18715 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ea896349bd4207aaf6c293b6502681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:00 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:48470
I20260812 16:45:00.476404 19239 ts_tablet_manager.cc:1905] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:45:00.477632 19245 tablet_replica.cc:330] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: stopping tablet replica
I20260812 16:45:00.477803 19245 raft_consensus.cc:2229] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:45:00.478075 19245 raft_consensus.cc:2258] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:00.478446 19239 ts_tablet_manager.cc:1918] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:45:00.478518 19239 log.cc:1196] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/e0ea896349bd4207aaf6c293b6502681
I20260812 16:45:00.478791 19239 ts_tablet_manager.cc:1939] T e0ea896349bd4207aaf6c293b6502681 P 77477620e7f34338bb5816355a97d845: Deleting consensus metadata
I20260812 16:45:00.479322 18203 catalog_manager.cc:4841] TS 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): tablet e0ea896349bd4207aaf6c293b6502681 (table test-table [id=8ff203a8f7034dd289e81fa13ef8387d]) successfully deleted
I20260812 16:45:00.481390 19245 ts_tablet_manager.cc:1905] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:45:00.483197 19245 ts_tablet_manager.cc:1918] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:45:00.483328 19245 log.cc:1196] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/e0ea896349bd4207aaf6c293b6502681
I20260812 16:45:00.483623 19245 ts_tablet_manager.cc:1939] T e0ea896349bd4207aaf6c293b6502681 P 44926fa259a4489c9f55d5807c8215a7: Deleting consensus metadata
I20260812 16:45:00.484141 18201 catalog_manager.cc:4841] TS 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): tablet e0ea896349bd4207aaf6c293b6502681 (table test-table [id=8ff203a8f7034dd289e81fa13ef8387d]) successfully deleted
W20260812 16:45:00.492828 18201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:45203 (error 108)
I20260812 16:45:00.493081 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 18597
I20260812 16:45:00.496798 19169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:00.495455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45203 (local address 127.0.0.1:43994)
0812 16:45:00.496701 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:00.496746 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:45203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1222}
W20260812 16:45:00.496968 18201 catalog_manager.cc:4584] TS 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e0ea896349bd4207aaf6c293b6502681: Network error: Client connection negotiation failed: client connection to 127.21.114.65:45203: connect: Connection refused (error 111)
I20260812 16:45:00.507159 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 18872
I20260812 16:45:00.520500 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 18167
I20260812 16:45:20.534446 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35157
--webserver_interface=127.21.114.126
--webserver_port=36963
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:20.620036 19247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:20.620265 19247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:20.620288 19247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:20.621430 19247 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 16:45:20.621466 19247 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 16:45:20.621479 19247 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 16:45:20.621490 19247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:45:20.621503 19247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:20.621516 19247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:20.621528 19247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:45:20.621541 19247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:45:20.622997 19247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=36963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:20.623191 19247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:20.623363 19247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:20.633303 19256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:20.633306 19265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:20.633306 19259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:20.633332 19247 server_base.cc:1034] running on GCE node
I20260812 16:45:20.633796 19247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:20.634128 19247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:20.635277 19247 hybrid_clock.cc:648] HybridClock initialized: now 1786553120635266 us; error 29 us; skew 500 ppm
Aug 12 16:45:20 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553120, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:20.637945 19247 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:45:20.638427 19247 webserver.cc:460] Webserver started at http://127.21.114.126:36963/ using document root <none> and password file <none>
I20260812 16:45:20.638630 19247 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:20.638684 19247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:20.640075 19247 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:20.640849 19277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:20.641042 19247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:20.641136 19247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b841e7bbd30f428a8b7af0b440872d1e"
format_stamp: "Formatted at 2026-08-12 16:44:59 on dist-test-slave-45dx"
server_key: "9e254417da790ace1ff999025dd7ab1d"
server_key_iv: "2014c0c75efe8d4702a61452cfdae91b"
server_key_version: "encryptionkey@0"
I20260812 16:45:20.641556 19247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:20.649238 19247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:20.651675 19247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:20.651850 19247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:20.656008 19247 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:35157
I20260812 16:45:20.656076 19381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:35157 every 8 connection(s)
I20260812 16:45:20.656514 19247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:45:20.658071 19382 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:45:20.658757 19382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap starting.
I20260812 16:45:20.660755 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 19247
I20260812 16:45:20.661064 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:45203
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:35157
--webserver_port=33015
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:45:20.668059 19382 log.cc:824] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:20.670140 19382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:45:20.670475 19382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap complete.
I20260812 16:45:20.672982 19382 raft_consensus.cc:348] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:20.673250 19382 raft_consensus.cc:729] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841e7bbd30f428a8b7af0b440872d1e, State: Initialized, Role: FOLLOWER
I20260812 16:45:20.673446 19382 consensus_queue.cc:260] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:20.673529 19382 raft_consensus.cc:388] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:45:20.673588 19382 raft_consensus.cc:482] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:45:20.673653 19382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 1 FOLLOWER]: Advancing to term 2
I20260812 16:45:20.674710 19382 raft_consensus.cc:504] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:20.674839 19382 leader_election.cc:302] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b841e7bbd30f428a8b7af0b440872d1e; no voters:
I20260812 16:45:20.675071 19382 leader_election.cc:288] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 16:45:20.675112 19391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Leader election won for term 2
I20260812 16:45:20.675305 19391 raft_consensus.cc:686] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 LEADER]: Becoming Leader. State: Replica: b841e7bbd30f428a8b7af0b440872d1e, State: Running, Role: LEADER
I20260812 16:45:20.675364 19382 sys_catalog.cc:564] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:45:20.675734 19391 consensus_queue.cc:237] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:20.676077 19395 sys_catalog.cc:455] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b841e7bbd30f428a8b7af0b440872d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } } }
I20260812 16:45:20.676186 19395 sys_catalog.cc:458] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:20.676097 19392 sys_catalog.cc:455] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b841e7bbd30f428a8b7af0b440872d1e. Latest consensus state: current_term: 2 leader_uuid: "b841e7bbd30f428a8b7af0b440872d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } } }
I20260812 16:45:20.676350 19392 sys_catalog.cc:458] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:20.676997 19408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:45:20.677877 19408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:45:20.678013 19408 catalog_manager.cc:1259] Loaded cluster ID: 0c4af13d00c54133b698f269c3277edd
I20260812 16:45:20.678048 19408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:45:20.678872 19408 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:45:20.679087 19408 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Loaded TSK: 0
I20260812 16:45:20.686022 19408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Generated new TSK 1
I20260812 16:45:20.686120 19408 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 16:45:20.759871 19384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:20.760076 19384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:20.760110 19384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:20.761366 19384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:20.761413 19384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:20.761439 19384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:45:20.762933 19384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:45203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=33015
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:20.763190 19384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:20.763454 19384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:20.768755 19439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:20.768847 19441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:20.769001 19384 server_base.cc:1034] running on GCE node
W20260812 16:45:20.768767 19438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:20.769331 19384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:20.769637 19384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:20.770831 19384 hybrid_clock.cc:648] HybridClock initialized: now 1786553120770811 us; error 32 us; skew 500 ppm
Aug 12 16:45:20 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553120, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:20.773898 19384 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:45:20.774441 19384 webserver.cc:460] Webserver started at http://127.21.114.65:33015/ using document root <none> and password file <none>
I20260812 16:45:20.774699 19384 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:20.774787 19384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:20.776243 19384 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:45:20.777033 19456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:20.777197 19384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:45:20.777304 19384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d379d0cede684b58215d29a4bea91e96"
server_key_iv: "11b8dff01548f7ab0369f0f0ad0f318a"
server_key_version: "encryptionkey@0"
I20260812 16:45:20.777765 19384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:20.800520 19384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:20.803061 19384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:20.803241 19384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:20.803511 19384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:20.804055 19463 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 16:45:20.805651 19384 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 16:45:20.805708 19384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 16:45:20.805734 19384 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 16:45:20.806413 19384 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 16:45:20.806460 19384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:20.806504 19463 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap starting.
I20260812 16:45:20.814442 19384 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:45203
I20260812 16:45:20.814630 19675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:45203 every 8 connection(s)
I20260812 16:45:20.815006 19384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:45:20.818128 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 19384
I20260812 16:45:20.818524 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:37803
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:35157
--webserver_port=34319
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:45:20.818872 19463 log.cc:824] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:20.821435 19463 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:45:20.821797 19463 tablet_bootstrap.cc:492] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap complete.
I20260812 16:45:20.822939 19463 ts_tablet_manager.cc:1397] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.004s
Aug 12 16:45:20 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553120, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:20.824157 19463 raft_consensus.cc:348] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:20.824532 19463 raft_consensus.cc:729] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703c58f8cf14b8384d99bdcbc6e0cfd, State: Initialized, Role: FOLLOWER
I20260812 16:45:20.824682 19463 consensus_queue.cc:260] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } } peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } }
I20260812 16:45:20.824990 19463 ts_tablet_manager.cc:1428] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 16:45:20.829180 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:20.815779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:56725)
0812 16:45:20.816019 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:20.816067 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:20.816701 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:20.817320 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:20.817325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:20.817764 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:20.818140 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:20.818148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.820063 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.820064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:20.821342 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:20.821345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.822398 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.822400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:20.822566 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:20.823233 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:20.823244 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:20.824996 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:20.827470 (+ 2474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:20.827477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:20.827479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:20.827703 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:20.828029 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:20.828029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:20.828030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:20.828126 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:20.828663 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:20.828669 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:20.828785 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 16:45:20.828871 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 16:45:20.828999 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":141,"threads_started":1}
I20260812 16:45:20.829856 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:20.815926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:56725 (local address 127.21.114.126:35157)
0812 16:45:20.816463 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:20.816477 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:20.816530 (+ 53us) server_negotiation.cc:407] Connection header received
0812 16:45:20.816962 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:20.816972 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:20.817057 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:20.817226 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:20.818411 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.819917 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.821445 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.822258 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.822381 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:20.825121 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:20.825125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:20.825125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:20.825136 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:20.827356 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:20.827803 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:20.827807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:20.827807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:20.827956 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:20.828206 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:20.828207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:20.828207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:20.828579 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:20.828672 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:20.828982 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 16:45:20.829145 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":82,"threads_started":1}
I20260812 16:45:20.830523 19676 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35157
I20260812 16:45:20.830637 19676 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:20.830850 19676 heartbeater.cc:511] Master 127.21.114.126:35157 requested a full tablet report, sending...
I20260812 16:45:20.831657 19306 ts_manager.cc:194] Registered new tserver with Master: 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203)
I20260812 16:45:20.832909 19306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:56725
I20260812 16:45:20.833771 19676 heartbeater.cc:503] Master 127.21.114.126:35157 was elected leader, sending a full tablet report...
Aug 12 16:45:20 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553120, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.65@KRBTEST.COM
I20260812 16:45:20.840855 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:20.832262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45203 (local address 127.0.0.1:54098)
0812 16:45:20.832538 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:20.832568 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:20.832640 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:20.832864 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:20.832869 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:20.833207 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:20.833284 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:20.833287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.834591 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.834592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:20.835165 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:20.835167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.835776 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.835777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:20.835848 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:20.836389 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:20.836394 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:20.837702 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:20.839682 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:20.839689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:20.839691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:20.839906 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:20.840128 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:20.840128 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:20.840129 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:20.840186 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:20.840558 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:20.840564 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:20.840613 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 16:45:20.840686 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 16:45:20.840781 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":142,"threads_started":1}
I20260812 16:45:20.840991 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:20.832375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54098 (local address 127.21.114.65:45203)
0812 16:45:20.832574 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:20.832578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:20.832623 (+ 45us) server_negotiation.cc:407] Connection header received
0812 16:45:20.832728 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:20.832730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:20.832749 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:20.832828 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:20.833358 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.834510 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.835243 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.835700 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.835771 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:20.837782 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:20.837790 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:20.837791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:20.837798 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:20.839592 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:20.839990 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:20.839994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:20.839994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:20.840060 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:20.840244 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:20.840245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:20.840245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:20.840482 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:20.840581 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:20.840755 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 16:45:20.840870 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":106,"threads_started":1}
I20260812 16:45:20.841529 19553 tablet_service.cc:1514] Processing DeleteTablet for tablet e0ea896349bd4207aaf6c293b6502681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:00 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:54098
I20260812 16:45:20.842176 19692 tablet_replica.cc:330] stopping tablet replica
I20260812 16:45:20.842296 19692 raft_consensus.cc:2229] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:45:20.842374 19692 raft_consensus.cc:2258] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:20.842670 19692 ts_tablet_manager.cc:1905] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:45:20.844666 19692 ts_tablet_manager.cc:1918] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:45:20.844727 19692 log.cc:1196] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal/wals/e0ea896349bd4207aaf6c293b6502681
I20260812 16:45:20.844971 19692 ts_tablet_manager.cc:1939] T e0ea896349bd4207aaf6c293b6502681 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Deleting consensus metadata
I20260812 16:45:20.845539 19280 catalog_manager.cc:4841] TS 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203): tablet e0ea896349bd4207aaf6c293b6502681 (table test-table [id=8ff203a8f7034dd289e81fa13ef8387d]) successfully deleted
W20260812 16:45:20.911586 19685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:20.911839 19685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:20.911890 19685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:20.913158 19685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:20.913228 19685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:20.913273 19685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:45:20.914922 19685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:37803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=34319
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:20.915205 19685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:20.915450 19685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:20.920743 19707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:20.920855 19685 server_base.cc:1034] running on GCE node
W20260812 16:45:20.920758 19709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:20.920754 19711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:20.921195 19685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:20.921401 19685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:20.922547 19685 hybrid_clock.cc:648] HybridClock initialized: now 1786553120922534 us; error 28 us; skew 500 ppm
Aug 12 16:45:20 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553120, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:20.925161 19685 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:45:20.925649 19685 webserver.cc:460] Webserver started at http://127.21.114.66:34319/ using document root <none> and password file <none>
I20260812 16:45:20.925911 19685 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:20.925999 19685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:20.927340 19685 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:20.927973 19726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:20.928144 19685 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:20.928252 19685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "44926fa259a4489c9f55d5807c8215a7"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d118b2cc7201af33cd231b023e9daf85"
server_key_iv: "e622118c0dc3e486dfed28bd071d4043"
server_key_version: "encryptionkey@0"
I20260812 16:45:20.928660 19685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:20.979619 19685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:20.981860 19685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:20.982034 19685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:20.982290 19685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:20.982620 19685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:20.982676 19685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:20.982721 19685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:20.982746 19685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:20.988698 19685 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:37803
I20260812 16:45:20.988749 19944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:37803 every 8 connection(s)
I20260812 16:45:20.989107 19685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:45:20 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553120, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:20.998755 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:20.989906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:47943 (local address 127.21.114.126:35157)
0812 16:45:20.989974 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:20.989977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:20.990213 (+ 236us) server_negotiation.cc:407] Connection header received
0812 16:45:20.990680 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:20.990681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:20.990695 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:20.990749 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:20.991737 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.992227 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.993269 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.993480 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.993531 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:20.995951 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:20.995953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:20.995953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:20.995960 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:20.997304 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:20.997721 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:20.997723 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:20.997723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:20.997783 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:20.998077 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:20.998078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:20.998078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:20.998199 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:20.998271 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:20.998562 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 16:45:20.998658 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:45:20.998769 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 19685
I20260812 16:45:20.998982 19950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:20.989908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:47943)
0812 16:45:20.990086 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:20.990125 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:20.990599 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:20.990857 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:20.990861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:20.991456 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:20.991659 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:20.991664 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.992363 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.992364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:20.993187 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:20.993189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:20.993553 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:20.993554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:20.993665 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:20.994243 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:20.994252 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:20.995814 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:20.997391 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:20.997400 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:20.997403 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:20.997640 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:20.997871 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:20.997872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:20.997873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:20.997999 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:20.998276 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:20.998283 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:20.998431 (+ 148us) client_negotiation.cc:769] Sending connection context
0812 16:45:20.998540 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 16:45:20.998708 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260812 16:45:20.999142 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:38835
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:35157
--webserver_port=44109
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:45:20.999527 19947 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35157
I20260812 16:45:20.999639 19947 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:20.999856 19947 heartbeater.cc:511] Master 127.21.114.126:35157 requested a full tablet report, sending...
I20260812 16:45:21.000269 19306 ts_manager.cc:194] Registered new tserver with Master: 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803)
I20260812 16:45:21.000685 19306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:47943
W20260812 16:45:21.086087 19953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:21.086308 19953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:21.086334 19953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:21.087430 19953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:21.087464 19953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:21.087491 19953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:45:21.088948 19953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:38835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=44109
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:21.089156 19953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:21.089346 19953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:21.094471 19966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:21.094477 19965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:21.094571 19971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:21.094686 19953 server_base.cc:1034] running on GCE node
I20260812 16:45:21.095036 19953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:21.095347 19953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:21.096515 19953 hybrid_clock.cc:648] HybridClock initialized: now 1786553121096510 us; error 39 us; skew 500 ppm
Aug 12 16:45:21 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553121, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:21.099261 19953 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:45:21.099738 19953 webserver.cc:460] Webserver started at http://127.21.114.67:44109/ using document root <none> and password file <none>
I20260812 16:45:21.099956 19953 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:21.100010 19953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:21.101444 19953 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:21.101989 19987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:21.102169 19953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:21.102263 19953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "77477620e7f34338bb5816355a97d845"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d8cde8298f2a58883ec84accdd83be57"
server_key_iv: "abd7c88da77b0b8dd0ab0dde49015f29"
server_key_version: "encryptionkey@0"
I20260812 16:45:21.102592 19953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:21.116847 19953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:21.118886 19953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:21.119043 19953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:21.119273 19953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:21.119582 19953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:21.119617 19953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:21.119663 19953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:21.119696 19953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:21.125568 19953 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:38835
I20260812 16:45:21.125650 20213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:38835 every 8 connection(s)
I20260812 16:45:21.126006 19953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:45:21 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553121, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:21.135128 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.126785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:39835 (local address 127.21.114.126:35157)
0812 16:45:21.126855 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.126858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.127083 (+ 225us) server_negotiation.cc:407] Connection header received
0812 16:45:21.127558 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.127559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.127569 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.127622 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:21.128643 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.129125 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.130081 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.130260 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.130310 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.132595 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:21.132597 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:21.132597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:21.132605 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:21.133903 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:21.134278 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:21.134278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:21.134279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:21.134336 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:21.134572 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:21.134574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:21.134574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:21.134695 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:21.134756 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.134987 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.135059 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 16:45:21.135298 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.126785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:39835)
0812 16:45:21.126962 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:21.126998 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:21.127476 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:21.127678 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:21.127682 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:21.128278 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:21.128563 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.128568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.129204 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.129205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.130007 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.130009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.130337 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.130338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.130437 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.130979 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:21.130987 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:21.132474 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:21.133975 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:21.133981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:21.133983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:21.134195 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:21.134397 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:21.134397 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:21.134398 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:21.134494 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:21.134756 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:21.134760 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:21.134875 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 16:45:21.134955 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 16:45:21.135073 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
I20260812 16:45:21.135787 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 19953
I20260812 16:45:21.135996 20217 heartbeater.cc:347] Connected to a master server at 127.21.114.126:35157
I20260812 16:45:21.136101 20217 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:21.136293 20217 heartbeater.cc:511] Master 127.21.114.126:35157 requested a full tablet report, sending...
I20260812 16:45:21.136790 19306 ts_manager.cc:194] Registered new tserver with Master: 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
I20260812 16:45:21.137317 19306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:39835
I20260812 16:45:21.142421 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.136235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45030 (local address 127.21.114.126:35157)
0812 16:45:21.136279 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.136281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.136504 (+ 223us) server_negotiation.cc:407] Connection header received
0812 16:45:21.136585 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.136586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.136595 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.136677 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:21.137461 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.137999 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.138728 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.138901 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.138949 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.140031 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:21.140032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:21.140032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:21.140038 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:21.141489 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:21.141804 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:21.141805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:21.141805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:21.141855 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:21.142029 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:21.142029 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:21.142029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:21.142118 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:21.142242 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.142272 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.142339 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:45:21.143258 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:45:21.145788 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.143623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45038 (local address 127.21.114.126:35157)
0812 16:45:21.143684 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.143686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.143785 (+ 99us) server_negotiation.cc:407] Connection header received
0812 16:45:21.143847 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.143848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.143874 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.143929 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:45:21.143996 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.144500 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.145213 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.145395 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.145445 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.145580 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:45:21.145619 (+ 39us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 16:45:21.145749 (+ 130us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45038: token expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 16:45:21.145833 19681 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45038: token expired
W20260812 16:45:21.145977 19153 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.114.126:35157)
I20260812 16:45:21.151518 19681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.146224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.21.114.126:35157)
0812 16:45:21.146264 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.146266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.146274 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:45:21.146329 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.146330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.146339 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.146400 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:21.146843 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.147281 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.147970 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.148170 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.148244 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.149287 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:21.149289 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:21.149289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:21.149296 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:21.150428 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:21.150763 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:21.150764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:21.150764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:21.150821 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:21.151028 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:21.151029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:21.151029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:21.151140 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:21.151243 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.151343 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.151424 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:45:21.152730 19306 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:45:21.154295 19306 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:45:21.156535 19553 tablet_service.cc:1467] Processing CreateTablet for tablet 5ace77f67135408ea3df553b530b3e71 (DEFAULT_TABLE table=test-table [id=639179562553498b9faf3e2fa6cf8078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:21.156757 19553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ace77f67135408ea3df553b530b3e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:21.158125 19463 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap starting.
I20260812 16:45:21.158456 19463 tablet_bootstrap.cc:654] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:21.159044 19463 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: No bootstrap required, opened a new log
I20260812 16:45:21.159111 19463 ts_tablet_manager.cc:1397] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:21.159487 19463 raft_consensus.cc:348] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.159574 19463 raft_consensus.cc:374] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:21.159621 19463 raft_consensus.cc:729] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703c58f8cf14b8384d99bdcbc6e0cfd, State: Initialized, Role: FOLLOWER
I20260812 16:45:21.159669 19463 consensus_queue.cc:260] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.159756 19463 ts_tablet_manager.cc:1428] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:21.160597 20232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.156448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35136 (local address 127.21.114.67:38835)
0812 16:45:21.156647 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.156651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.156662 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:45:21.156700 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.156702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.156718 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.156801 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:21.157072 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.158118 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.159399 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.160156 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.160234 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.160343 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.160480 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.160521 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":86,"threads_started":1}
I20260812 16:45:21.160610 20228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.156252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38835 (local address 127.0.0.1:35136)
0812 16:45:21.156554 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:21.156566 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:21.156617 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:21.156897 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:21.156898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:21.156900 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:21.156957 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.156959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.158200 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.158200 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.159299 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.159302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.160257 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.160258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.160365 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.160396 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 16:45:21.160455 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 16:45:21.160504 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":3,"thread_start_us":168,"threads_started":1}
I20260812 16:45:21.160794 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.156180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:37803 (local address 127.0.0.1:56140)
0812 16:45:21.156214 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:21.156225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:21.156263 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:21.156729 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:21.156730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:21.156732 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:21.156782 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.156784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.158083 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.158084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.159299 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.159302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.160603 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.160603 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.160674 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.160678 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:45:21.160709 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 16:45:21.160746 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18,"mutex_wait_us":6}
I20260812 16:45:21.161202 20229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.156328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.21.114.66:37803)
0812 16:45:21.156533 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.156538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.156551 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:45:21.156596 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.156598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.156617 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.156724 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:21.156846 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.157983 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.159409 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.160517 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.160984 (+ 467us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.161039 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.161061 (+ 22us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.161117 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":132,"threads_started":1}
I20260812 16:45:21.161578 20068 tablet_service.cc:1467] Processing CreateTablet for tablet 5ace77f67135408ea3df553b530b3e71 (DEFAULT_TABLE table=test-table [id=639179562553498b9faf3e2fa6cf8078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:21.161793 19824 tablet_service.cc:1467] Processing CreateTablet for tablet 5ace77f67135408ea3df553b530b3e71 (DEFAULT_TABLE table=test-table [id=639179562553498b9faf3e2fa6cf8078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:21.161927 20068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ace77f67135408ea3df553b530b3e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:21.162124 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ace77f67135408ea3df553b530b3e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:21.164882 20238 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Bootstrap starting.
I20260812 16:45:21.164881 20236 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Bootstrap starting.
I20260812 16:45:21.165620 20238 tablet_bootstrap.cc:654] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:21.165752 20236 tablet_bootstrap.cc:654] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:21.166168 20238 log.cc:824] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:21.166294 20236 log.cc:824] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:21.167057 20236 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: No bootstrap required, opened a new log
I20260812 16:45:21.167052 20238 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: No bootstrap required, opened a new log
I20260812 16:45:21.167127 20238 ts_tablet_manager.cc:1397] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:45:21.167127 20236 ts_tablet_manager.cc:1397] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:45:21.169183 20238 raft_consensus.cc:348] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.169232 20236 raft_consensus.cc:348] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.169376 20238 raft_consensus.cc:374] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:21.169376 20236 raft_consensus.cc:374] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:21.169423 20236 raft_consensus.cc:729] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77477620e7f34338bb5816355a97d845, State: Initialized, Role: FOLLOWER
I20260812 16:45:21.169420 20238 raft_consensus.cc:729] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44926fa259a4489c9f55d5807c8215a7, State: Initialized, Role: FOLLOWER
I20260812 16:45:21.169544 20238 consensus_queue.cc:260] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.169544 20236 consensus_queue.cc:260] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.169827 20238 ts_tablet_manager.cc:1428] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:45:21.169827 20236 ts_tablet_manager.cc:1428] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:45:21.169859 20217 heartbeater.cc:503] Master 127.21.114.126:35157 was elected leader, sending a full tablet report...
I20260812 16:45:21.169974 19947 heartbeater.cc:503] Master 127.21.114.126:35157 was elected leader, sending a full tablet report...
W20260812 16:45:21.239696 19948 tablet.cc:2369] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:45:21.295302 20242 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:21.295496 20242 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.295910 20242 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203)
I20260812 16:45:21.298985 20229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.296346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:33773 (local address 127.21.114.66:37803)
0812 16:45:21.296402 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.296404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.296418 (+ 14us) server_negotiation.cc:407] Connection header received
0812 16:45:21.296461 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.296462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.296474 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.296536 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:21.296726 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.297216 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.298228 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.298609 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.298698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.298707 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.298879 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.298919 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:45:21.298985 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.296214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:37803 (local address 127.21.114.67:33773)
0812 16:45:21.296295 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:21.296330 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:21.296401 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:21.296578 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:21.296579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:21.296581 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:21.296649 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.296651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.297320 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.297321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.298109 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.298111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.298696 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.298697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.298789 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.298792 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:45:21.298869 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 16:45:21.298909 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 16:45:21.299139 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.296477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:32953 (local address 127.21.114.65:45203)
0812 16:45:21.296550 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.296552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.296658 (+ 106us) server_negotiation.cc:407] Connection header received
0812 16:45:21.296742 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.296742 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.296765 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.296849 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:21.297014 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.297496 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.298427 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.298817 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.298911 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.298988 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.299036 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.299072 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:45:21.299156 20246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.296387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45203 (local address 127.21.114.67:32953)
0812 16:45:21.296582 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:21.296591 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:21.296666 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:21.296856 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:21.296857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:21.296858 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:21.296936 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.296937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.297585 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.297586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.298332 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:21.298334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.298909 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.298910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:21.298977 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.298980 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:45:21.299030 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 16:45:21.299070 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":133,"threads_started":1}
I20260812 16:45:21.299364 19863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ace77f67135408ea3df553b530b3e71" candidate_uuid: "77477620e7f34338bb5816355a97d845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44926fa259a4489c9f55d5807c8215a7" is_pre_election: true
I20260812 16:45:21.299543 19863 raft_consensus.cc:2454] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77477620e7f34338bb5816355a97d845 in term 0.
I20260812 16:45:21.299657 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ace77f67135408ea3df553b530b3e71" candidate_uuid: "77477620e7f34338bb5816355a97d845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" is_pre_election: true
I20260812 16:45:21.299764 19997 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845; no voters:
I20260812 16:45:21.299861 19596 raft_consensus.cc:2454] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77477620e7f34338bb5816355a97d845 in term 0.
I20260812 16:45:21.299892 20242 raft_consensus.cc:2781] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:45:21.299979 20242 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:45:21.300005 20242 raft_consensus.cc:3037] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:21.300838 20242 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.300982 20242 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [CANDIDATE]: Term 1 election: Requested vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203)
I20260812 16:45:21.301139 19863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ace77f67135408ea3df553b530b3e71" candidate_uuid: "77477620e7f34338bb5816355a97d845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44926fa259a4489c9f55d5807c8215a7"
I20260812 16:45:21.301153 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ace77f67135408ea3df553b530b3e71" candidate_uuid: "77477620e7f34338bb5816355a97d845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
I20260812 16:45:21.301223 19863 raft_consensus.cc:3037] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:21.301258 19596 raft_consensus.cc:3037] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:21.302088 19863 raft_consensus.cc:2454] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77477620e7f34338bb5816355a97d845 in term 1.
I20260812 16:45:21.302181 19596 raft_consensus.cc:2454] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77477620e7f34338bb5816355a97d845 in term 1.
I20260812 16:45:21.302239 19997 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845; no voters:
I20260812 16:45:21.302325 20242 raft_consensus.cc:2781] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:45:21.302464 20242 raft_consensus.cc:686] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 1 LEADER]: Becoming Leader. State: Replica: 77477620e7f34338bb5816355a97d845, State: Running, Role: LEADER
I20260812 16:45:21.302563 20242 consensus_queue.cc:237] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:21.303514 19306 catalog_manager.cc:5495] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77477620e7f34338bb5816355a97d845 (127.21.114.67). New cstate: current_term: 1 leader_uuid: "77477620e7f34338bb5816355a97d845" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } health_report { overall_health: UNKNOWN } } }
W20260812 16:45:21.316116 19677 tablet.cc:2369] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:45:21.342548 20232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.340366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35146 (local address 127.21.114.67:38835)
0812 16:45:21.340432 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:21.340436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:21.340449 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:45:21.340486 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:21.340486 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:21.340505 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:21.340571 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:45:21.340689 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.341163 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.341884 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:21.342062 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:21.342114 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:21.342253 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:45:21.342354 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:45:21.342417 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:21.342450 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 16:45:21.342467 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 16:45:21.344477 19863 raft_consensus.cc:1261] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Refusing update from remote peer 77477620e7f34338bb5816355a97d845: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:45:21.344473 19596 raft_consensus.cc:1261] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Refusing update from remote peer 77477620e7f34338bb5816355a97d845: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:45:21.344816 20242 consensus_queue.cc:1035] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:45:21.345010 20248 consensus_queue.cc:1035] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:45:21.347107 20254 mvcc.cc:205] Tried to move back new op lower bound from 7317721585024032768 to 7317721584856276992. Current Snapshot: MvccSnapshot[applied={T|T < 7317721585024032768}]
I20260812 16:45:21.348106 20255 mvcc.cc:205] Tried to move back new op lower bound from 7317721585024032768 to 7317721584856276992. Current Snapshot: MvccSnapshot[applied={T|T < 7317721585024032768}]
I20260812 16:45:21.348158 20257 mvcc.cc:205] Tried to move back new op lower bound from 7317721585024032768 to 7317721584856276992. Current Snapshot: MvccSnapshot[applied={T|T < 7317721585024032768 or (T in {7317721585024032768})}]
I20260812 16:45:21.349556 19304 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:45:21.349651 19304 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:45:21.350428 19304 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Sending DeleteTablet for 3 replicas of tablet 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:21.350833 19553 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ace77f67135408ea3df553b530b3e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:21 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:54098
I20260812 16:45:21.350872 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 19384
I20260812 16:45:21.350875 19824 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ace77f67135408ea3df553b530b3e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:21 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:56140
I20260812 16:45:21.365111 20068 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ace77f67135408ea3df553b530b3e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:21 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:35136
I20260812 16:45:21.367061 20267 tablet_replica.cc:330] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: stopping tablet replica
I20260812 16:45:21.367156 20266 tablet_replica.cc:330] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: stopping tablet replica
I20260812 16:45:21.367286 20267 raft_consensus.cc:2229] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:45:21.367363 20266 raft_consensus.cc:2229] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:45:21.367504 20267 raft_consensus.cc:2258] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:21.367524 20266 raft_consensus.cc:2258] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:21.368964 20267 ts_tablet_manager.cc:1905] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:45:21.369105 20266 ts_tablet_manager.cc:1905] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:45:21.370795 20267 ts_tablet_manager.cc:1918] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:45:21.370949 20267 log.cc:1196] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/5ace77f67135408ea3df553b530b3e71
I20260812 16:45:21.371090 20266 ts_tablet_manager.cc:1918] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:45:21.371176 20266 log.cc:1196] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/5ace77f67135408ea3df553b530b3e71
I20260812 16:45:21.371445 20267 ts_tablet_manager.cc:1939] T 5ace77f67135408ea3df553b530b3e71 P 77477620e7f34338bb5816355a97d845: Deleting consensus metadata
I20260812 16:45:21.371501 20266 ts_tablet_manager.cc:1939] T 5ace77f67135408ea3df553b530b3e71 P 44926fa259a4489c9f55d5807c8215a7: Deleting consensus metadata
I20260812 16:45:21.372006 19283 catalog_manager.cc:4841] TS 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): tablet 5ace77f67135408ea3df553b530b3e71 (table test-table [id=639179562553498b9faf3e2fa6cf8078]) successfully deleted
I20260812 16:45:21.372071 19280 catalog_manager.cc:4841] TS 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): tablet 5ace77f67135408ea3df553b530b3e71 (table test-table [id=639179562553498b9faf3e2fa6cf8078]) successfully deleted
W20260812 16:45:21.374121 19280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:45203 (error 108)
I20260812 16:45:21.374599 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 19685
I20260812 16:45:21.381369 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:21.381079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:45203 (local address 127.0.0.1:54108)
0812 16:45:21.381253 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:21.381319 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:45203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260812 16:45:21.383513 19280 catalog_manager.cc:4584] TS 5703c58f8cf14b8384d99bdcbc6e0cfd (127.21.114.65:45203): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5ace77f67135408ea3df553b530b3e71: Network error: Client connection negotiation failed: client connection to 127.21.114.65:45203: connect: Connection refused (error 111)
I20260812 16:45:21.388652 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 19953
I20260812 16:45:21.402204 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 19247
I20260812 16:45:41.418491 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35157
--webserver_interface=127.21.114.126
--webserver_port=36963
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:35157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:41.505848 20271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:41.506068 20271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:41.506091 20271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:41.507210 20271 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 16:45:41.507241 20271 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 16:45:41.507253 20271 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 16:45:41.507266 20271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:45:41.507278 20271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:41.507292 20271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:41.507303 20271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:45:41.507315 20271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:45:41.508846 20271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:35157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:35157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=36963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:41.509055 20271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:41.509231 20271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:41.514662 20286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:41.514698 20288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:41.514662 20291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:41.514858 20271 server_base.cc:1034] running on GCE node
I20260812 16:45:41.515128 20271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:41.515451 20271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:41.516621 20271 hybrid_clock.cc:648] HybridClock initialized: now 1786553141516608 us; error 47 us; skew 500 ppm
Aug 12 16:45:41 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553141, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:41.525672 20271 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:45:41.526197 20271 webserver.cc:460] Webserver started at http://127.21.114.126:36963/ using document root <none> and password file <none>
I20260812 16:45:41.526443 20271 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:41.526515 20271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:41.527947 20271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:41.528741 20305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:41.528924 20271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:41.529037 20271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b841e7bbd30f428a8b7af0b440872d1e"
format_stamp: "Formatted at 2026-08-12 16:44:59 on dist-test-slave-45dx"
server_key: "9e254417da790ace1ff999025dd7ab1d"
server_key_iv: "2014c0c75efe8d4702a61452cfdae91b"
server_key_version: "encryptionkey@0"
I20260812 16:45:41.529435 20271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:41.541343 20271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:41.543764 20271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:41.543934 20271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:41.548259 20271 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:35157
I20260812 16:45:41.548292 20419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:35157 every 8 connection(s)
I20260812 16:45:41.548736 20271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:45:41.550330 20420 sys_catalog.cc:263] Verifying existing consensus state
I20260812 16:45:41.550946 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap starting.
I20260812 16:45:41.555011 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 20271
I20260812 16:45:41.555310 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:45203
--local_ip_for_outbound_sockets=127.21.114.65
--tserver_master_addrs=127.21.114.126:35157
--webserver_port=33015
--webserver_interface=127.21.114.65
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:45:41.560189 20420 log.cc:824] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:41.562467 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:45:41.562806 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Bootstrap complete.
I20260812 16:45:41.565222 20420 raft_consensus.cc:348] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:41.565454 20420 raft_consensus.cc:729] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b841e7bbd30f428a8b7af0b440872d1e, State: Initialized, Role: FOLLOWER
I20260812 16:45:41.565627 20420 consensus_queue.cc:260] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:41.565714 20420 raft_consensus.cc:388] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:45:41.565770 20420 raft_consensus.cc:482] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:45:41.565846 20420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 2 FOLLOWER]: Advancing to term 3
I20260812 16:45:41.566846 20420 raft_consensus.cc:504] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:41.566969 20420 leader_election.cc:302] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b841e7bbd30f428a8b7af0b440872d1e; no voters:
I20260812 16:45:41.567175 20420 leader_election.cc:288] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 16:45:41.567211 20428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 3 FOLLOWER]: Leader election won for term 3
I20260812 16:45:41.567351 20428 raft_consensus.cc:686] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [term 3 LEADER]: Becoming Leader. State: Replica: b841e7bbd30f428a8b7af0b440872d1e, State: Running, Role: LEADER
I20260812 16:45:41.567441 20428 consensus_queue.cc:237] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } }
I20260812 16:45:41.567480 20420 sys_catalog.cc:564] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:45:41.567685 20428 sys_catalog.cc:455] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b841e7bbd30f428a8b7af0b440872d1e. Latest consensus state: current_term: 3 leader_uuid: "b841e7bbd30f428a8b7af0b440872d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } } }
I20260812 16:45:41.567762 20428 sys_catalog.cc:458] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:41.567690 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b841e7bbd30f428a8b7af0b440872d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b841e7bbd30f428a8b7af0b440872d1e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 35157 } } }
I20260812 16:45:41.567945 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:41.567972 20443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:45:41.568956 20443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:45:41.569085 20443 catalog_manager.cc:1259] Loaded cluster ID: 0c4af13d00c54133b698f269c3277edd
I20260812 16:45:41.569265 20443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:45:41.570221 20443 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:45:41.570427 20443 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Loaded TSK: 0
I20260812 16:45:41.570497 20443 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b841e7bbd30f428a8b7af0b440872d1e: Loaded TSK: 1
F20260812 16:45:41.570712 20443 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fad9f96d9ad google::LogMessage::Fail() at ??:0
@ 0x7fad9f97088a google::LogMessage::SendToLog() at ??:0
@ 0x7fad9f96d4de google::LogMessage::Flush() at ??:0
@ 0x7fad9f96ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fada20da104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fada20d7d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fada78c71cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fada78c748e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fada78c7594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fada788dc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fada7897ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fada183b0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fada1830954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fada26946db start_thread at ??:0
@ 0x7fad9e46b61f clone at ??:0
W20260812 16:45:41.656205 20424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:41.656518 20424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:41.656559 20424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:41.657716 20424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:41.657785 20424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:41.657828 20424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:45:41.659296 20424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:45203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=33015
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:41.659569 20424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:41.659818 20424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:41.665127 20508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:41.665215 20510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:41.665177 20424 server_base.cc:1034] running on GCE node
W20260812 16:45:41.665146 20507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:41.665518 20424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:41.665810 20424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:41.666980 20424 hybrid_clock.cc:648] HybridClock initialized: now 1786553141666968 us; error 28 us; skew 500 ppm
Aug 12 16:45:41 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553141, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:41.669780 20424 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:45:41.670323 20424 webserver.cc:460] Webserver started at http://127.21.114.65:33015/ using document root <none> and password file <none>
I20260812 16:45:41.670595 20424 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:41.670672 20424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:41.672564 20424 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:45:41.673444 20523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:41.673662 20424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:41.673767 20424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d379d0cede684b58215d29a4bea91e96"
server_key_iv: "11b8dff01548f7ab0369f0f0ad0f318a"
server_key_version: "encryptionkey@0"
I20260812 16:45:41.674253 20424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:41.718731 20424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:41.721364 20424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:41.721520 20424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:41.721817 20424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:41.722302 20540 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 16:45:41.724427 20424 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 16:45:41.724498 20424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 16:45:41.724543 20424 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 16:45:41.725217 20424 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 16:45:41.725276 20424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:41.725358 20540 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap starting.
I20260812 16:45:41.732887 20424 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:45203
I20260812 16:45:41.733029 20755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:45203 every 8 connection(s)
I20260812 16:45:41.733358 20424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:45:41.737110 20540 log.cc:824] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:41.739969 20540 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 16:45:41.740345 20540 tablet_bootstrap.cc:492] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Bootstrap complete.
I20260812 16:45:41.741585 20540 ts_tablet_manager.cc:1397] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.013s
I20260812 16:45:41.742136 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 20424
I20260812 16:45:41.742446 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:37803
--local_ip_for_outbound_sockets=127.21.114.66
--tserver_master_addrs=127.21.114.126:35157
--webserver_port=34319
--webserver_interface=127.21.114.66
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:45:41.743202 20540 raft_consensus.cc:348] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:41.743597 20540 raft_consensus.cc:729] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703c58f8cf14b8384d99bdcbc6e0cfd, State: Initialized, Role: FOLLOWER
I20260812 16:45:41.743779 20540 consensus_queue.cc:260] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:41.744076 20540 ts_tablet_manager.cc:1428] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260812 16:45:41.807732 20763 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:45:41.734109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:53089)
0812 16:45:41.734286 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:41.734339 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:41.734810 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:41.807486 (+ 72676us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
W20260812 16:45:41.808071 20759 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:35157 (0 consecutive failures): Network error: Failed to ping master at 127.21.114.126:35157: Client connection negotiation failed: client connection to 127.21.114.126:35157: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 16:45:41.808498 20763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:41.808379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:38007)
0812 16:45:41.808432 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:41.808477 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 16:45:41.808880 20763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:41.808769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:40081)
0812 16:45:41.808820 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:41.808851 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 16:45:41.808993 20759 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 16:45:41.849049 20766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:41.849300 20766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:41.849341 20766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:41.850620 20766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:41.850692 20766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:41.850735 20766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:45:41.852227 20766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:37803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=34319
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:41.852530 20766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:41.852773 20766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:41.858014 20795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:41.858034 20789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:41.858047 20788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:41.858192 20766 server_base.cc:1034] running on GCE node
I20260812 16:45:41.858538 20766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:41.858829 20766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:41.860008 20766 hybrid_clock.cc:648] HybridClock initialized: now 1786553141859994 us; error 42 us; skew 500 ppm
Aug 12 16:45:41 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553141, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:41.862861 20766 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:45:41.863267 20766 webserver.cc:460] Webserver started at http://127.21.114.66:34319/ using document root <none> and password file <none>
I20260812 16:45:41.863483 20766 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:41.863526 20766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:41.864941 20766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:41.865585 20818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:41.865860 20766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:41.865967 20766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "44926fa259a4489c9f55d5807c8215a7"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d118b2cc7201af33cd231b023e9daf85"
server_key_iv: "e622118c0dc3e486dfed28bd071d4043"
server_key_version: "encryptionkey@0"
I20260812 16:45:41.866319 20766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:41.880153 20766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:41.882323 20766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:41.882454 20766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:41.882647 20766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:41.882972 20766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:41.883009 20766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:41.883033 20766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:41.883081 20766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:41.888991 20766 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:37803
I20260812 16:45:41.889093 21053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:37803 every 8 connection(s)
I20260812 16:45:41.889441 20766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:45:41.890597 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:41.890147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:40595)
0812 16:45:41.890358 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:41.890441 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":78,"threads_started":1}
W20260812 16:45:41.891105 21054 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:35157 (0 consecutive failures): Network error: Failed to ping master at 127.21.114.126:35157: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
I20260812 16:45:41.891429 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:41.891329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:45567)
0812 16:45:41.891378 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:41.891410 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 16:45:41.891789 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:41.891641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:54391)
0812 16:45:41.891736 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:41.891768 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260812 16:45:41.891956 21054 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 16:45:41.894572 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 20766
I20260812 16:45:41.894891 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:38835
--local_ip_for_outbound_sockets=127.21.114.67
--tserver_master_addrs=127.21.114.126:35157
--webserver_port=44109
--webserver_interface=127.21.114.67
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:41.979919 21060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:41.980121 21060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:41.980144 21060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:41.981262 21060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:41.981302 21060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:41.981328 21060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:45:41.982707 21060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:38835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=44109
--tserver_master_addrs=127.21.114.126:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:41.982925 21060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:41.983104 21060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:41.988374 21075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:41.988523 21060 server_base.cc:1034] running on GCE node
W20260812 16:45:41.988348 21085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:41.988389 21070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:41.988879 21060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:41.989151 21060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:41.990322 21060 hybrid_clock.cc:648] HybridClock initialized: now 1786553141990302 us; error 48 us; skew 500 ppm
Aug 12 16:45:41 dist-test-slave-45dx krb5kdc[18142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553141, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:41.992908 21060 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:45:41.993371 21060 webserver.cc:460] Webserver started at http://127.21.114.67:44109/ using document root <none> and password file <none>
I20260812 16:45:41.993559 21060 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:41.993600 21060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:41.994894 21060 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:41.995474 21100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:41.995673 21060 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:45:41.995747 21060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "77477620e7f34338bb5816355a97d845"
format_stamp: "Formatted at 2026-08-12 16:45:00 on dist-test-slave-45dx"
server_key: "d8cde8298f2a58883ec84accdd83be57"
server_key_iv: "abd7c88da77b0b8dd0ab0dde49015f29"
server_key_version: "encryptionkey@0"
I20260812 16:45:41.996090 21060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:42.007526 21060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:42.009492 21060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:42.009611 21060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:42.009804 21060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:42.010076 21060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:42.010108 21060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:42.010131 21060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:42.010144 21060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:42.016211 21060 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:38835
I20260812 16:45:42.016270 21307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:38835 every 8 connection(s)
I20260812 16:45:42.016649 21060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:45:42.017786 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:42.017345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:43773)
0812 16:45:42.017566 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:42.017641 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":151,"threads_started":1}
W20260812 16:45:42.018271 21308 heartbeater.cc:644] Failed to heartbeat to 127.21.114.126:35157 (0 consecutive failures): Network error: Failed to ping master at 127.21.114.126:35157: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
I20260812 16:45:42.018643 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:42.018477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:33361)
0812 16:45:42.018577 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:42.018611 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 16:45:42.018980 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:42.018893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:36097)
0812 16:45:42.018940 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:42.018963 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 16:45:42.019122 21308 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 16:45:42.020659 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 21060
I20260812 16:45:42.809690 21315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:42.809402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:57521)
0812 16:45:42.809574 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:42.809619 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":71,"threads_started":1}
I20260812 16:45:42.892575 21319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:42.892339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:42513)
0812 16:45:42.892475 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:42.892517 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":56,"threads_started":1}
I20260812 16:45:43.019680 21322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.019463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:56181)
0812 16:45:43.019591 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:43.019629 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260812 16:45:43.088596 21326 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:43.088726 21326 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:43.089056 21326 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
Aug 12 16:45:43 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553141, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.66@KRBTEST.COM
Aug 12 16:45:43 dist-test-slave-45dx krb5kdc[18142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553141, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.67@KRBTEST.COM
I20260812 16:45:43.100660 21334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.089406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:60105 (local address 127.21.114.67:38835)
0812 16:45:43.089585 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:43.089592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:43.089616 (+ 24us) server_negotiation.cc:407] Connection header received
0812 16:45:43.090166 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:43.090169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:43.090238 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:43.090395 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:43.091102 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.091957 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.093034 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.093448 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.093570 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:43.096642 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:43.096646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:43.096647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:43.096661 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:43.098531 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:43.099236 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:43.099239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:43.099239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:43.099338 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:43.099637 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:43.099638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:43.099639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:43.100004 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:43.100106 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:43.100397 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 16:45:43.100537 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":78,"threads_started":1}
I20260812 16:45:43.100648 21315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.089224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:37803 (local address 127.21.114.65:46011)
0812 16:45:43.089287 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:43.089298 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:43.089357 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:43.090435 (+ 1078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:43.090438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:43.090753 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:43.090951 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:43.090957 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.092071 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.092073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:43.092932 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:43.092934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.093544 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.093545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:43.093667 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:43.094430 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:43.094435 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:43.096104 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:43.098613 (+ 2509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:43.098621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:43.098624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:43.099124 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:43.099417 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:43.099417 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:43.099418 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:43.099557 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:43.100061 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:43.100069 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:43.100207 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 16:45:43.100338 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 16:45:43.100548 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":6}
I20260812 16:45:43.100680 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.089350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:46011 (local address 127.21.114.66:37803)
0812 16:45:43.089498 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:43.089510 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:43.089548 (+ 38us) server_negotiation.cc:407] Connection header received
0812 16:45:43.090179 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:43.090182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:43.090233 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:43.090395 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:43.091073 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.091957 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.093034 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.093446 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.093570 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:43.096216 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:43.096220 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:43.096221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:43.096233 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:43.098488 (+ 2255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:43.099214 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:43.099218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:43.099218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:43.099334 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:43.099631 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:43.099632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:43.099632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:43.099965 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:43.100085 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:43.100400 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 16:45:43.100541 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260812 16:45:43.100771 21327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.089261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38835 (local address 127.21.114.65:60105)
0812 16:45:43.089431 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:43.089441 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:43.089504 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:43.090529 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:43.090532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:43.090780 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:43.090952 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:43.090957 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.092077 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.092078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:43.092934 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:43.092937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:43.093546 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:43.093547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:43.093667 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:43.094365 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:43.094374 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:43.096502 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:43.098654 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:43.098655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:43.098655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:43.099124 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:43.099418 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:43.099419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:43.099420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:43.099556 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:43.100100 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:43.100100 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:43.100206 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 16:45:43.100339 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 16:45:43.100634 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":192,"thread_start_us":103,"threads_started":1}
W20260812 16:45:43.101806 20532 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
W20260812 16:45:43.101950 20536 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:43.102015 20536 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703c58f8cf14b8384d99bdcbc6e0cfd; no voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845
I20260812 16:45:43.102144 21326 raft_consensus.cc:2726] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:45:43.810643 21335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.810413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:58555)
0812 16:45:43.810549 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:43.810593 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260812 16:45:43.893389 21336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:43.893148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:59475)
0812 16:45:43.893297 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:43.893341 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260812 16:45:44.020407 21338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:44.020142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:38313)
0812 16:45:44.020318 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:44.020362 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260812 16:45:44.689433 21342 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:44.689543 21342 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:44.689766 21342 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
W20260812 16:45:44.690268 20536 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
W20260812 16:45:44.690363 20532 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:44.690487 20532 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703c58f8cf14b8384d99bdcbc6e0cfd; no voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845
I20260812 16:45:44.690572 21342 raft_consensus.cc:2726] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:45:44.811465 21343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:44.811196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:34037)
0812 16:45:44.811348 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:44.811399 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260812 16:45:44.894126 21344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:44.893882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:36571)
0812 16:45:44.894036 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:44.894079 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":68,"threads_started":1}
I20260812 16:45:45.021147 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:45.020908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:52619)
0812 16:45:45.021066 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:45.021105 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260812 16:45:45.812450 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:45.812087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:53155)
0812 16:45:45.812274 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:45.812396 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
I20260812 16:45:45.894949 21349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:45.894661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:45911)
0812 16:45:45.894815 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:45.894886 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260812 16:45:46.022025 21353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:46.021756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:49563)
0812 16:45:46.021927 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:46.021977 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260812 16:45:46.813231 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:46.813001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:56733)
0812 16:45:46.813139 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:46.813179 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260812 16:45:46.895684 21356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:46.895468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:43235)
0812 16:45:46.895599 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:46.895635 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260812 16:45:47.022782 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:47.022569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:53143)
0812 16:45:47.022697 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:47.022734 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260812 16:45:47.229794 21359 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:47.229933 21359 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:47.230136 21359 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
W20260812 16:45:47.230577 20536 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
W20260812 16:45:47.230666 20532 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:47.230768 20532 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703c58f8cf14b8384d99bdcbc6e0cfd; no voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845
I20260812 16:45:47.230842 21359 raft_consensus.cc:2726] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:45:47.814002 21361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:47.813766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:52923)
0812 16:45:47.813907 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:47.813951 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260812 16:45:47.896502 21362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:47.896184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:33227)
0812 16:45:47.896415 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:47.896453 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":89,"threads_started":1}
I20260812 16:45:48.023569 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:48.023344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:56531)
0812 16:45:48.023490 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:48.023523 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260812 16:45:48.814749 21366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:48.814527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:56395)
0812 16:45:48.814665 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:48.814700 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260812 16:45:48.897348 21367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:48.896993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:58007)
0812 16:45:48.897123 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:48.897165 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260812 16:45:49.024271 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:49.024060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:46583)
0812 16:45:49.024190 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:49.024225 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260812 16:45:49.815490 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:49.815248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:44111)
0812 16:45:49.815398 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:49.815438 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
I20260812 16:45:49.898047 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:49.897801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:41991)
0812 16:45:49.897959 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:49.897996 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260812 16:45:50.024991 21379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:50.024729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:42501)
0812 16:45:50.024901 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:50.024941 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
I20260812 16:45:50.816265 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:50.815997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:51593)
0812 16:45:50.816178 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:50.816215 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":97,"threads_started":1}
I20260812 16:45:50.898777 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:50.898537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:60813)
0812 16:45:50.898693 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:50.898729 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":125,"threads_started":1}
I20260812 16:45:51.025707 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:51.025485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:37977)
0812 16:45:51.025625 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:51.025661 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260812 16:45:51.817085 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:51.816804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:41065)
0812 16:45:51.816987 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:51.817033 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":104,"threads_started":1}
I20260812 16:45:51.899505 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:51.899271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:50993)
0812 16:45:51.899418 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:51.899458 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260812 16:45:51.980815 21392 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:51.980921 21392 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:51.981146 21392 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
W20260812 16:45:51.981630 20536 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
W20260812 16:45:51.981758 20532 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:51.981838 20532 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703c58f8cf14b8384d99bdcbc6e0cfd; no voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845
I20260812 16:45:51.981940 21392 raft_consensus.cc:2726] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:45:52.026489 21393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:52.026227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:46791)
0812 16:45:52.026390 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:52.026420 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260812 16:45:52.817792 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:52.817556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:39163)
0812 16:45:52.817702 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:52.817740 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260812 16:45:52.900184 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:52.899956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:43071)
0812 16:45:52.900100 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:52.900137 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260812 16:45:53.027202 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:53.026968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:48595)
0812 16:45:53.027119 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:53.027152 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":61,"threads_started":1}
I20260812 16:45:53.818578 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:53.818330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:38227)
0812 16:45:53.818472 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:53.818514 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260812 16:45:53.900887 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:53.900637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:34799)
0812 16:45:53.900767 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:53.900807 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260812 16:45:54.028013 21405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:54.027790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:55101)
0812 16:45:54.027920 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:54.027955 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260812 16:45:54.477626 21406 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:54.477732 21406 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:54.477972 21406 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
W20260812 16:45:54.478418 20532 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
W20260812 16:45:54.478500 20536 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:54.478565 20536 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703c58f8cf14b8384d99bdcbc6e0cfd; no voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845
I20260812 16:45:54.478657 21406 raft_consensus.cc:2726] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:45:54.819321 21408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:54.819058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:48553)
0812 16:45:54.819225 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:54.819269 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":66,"threads_started":1}
I20260812 16:45:54.901619 21411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:54.901407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:45115)
0812 16:45:54.901533 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:54.901566 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260812 16:45:55.028867 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:55.028589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:55921)
0812 16:45:55.028757 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:55.028799 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260812 16:45:55.820076 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:55.819791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:40869)
0812 16:45:55.819980 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:55.820023 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":119,"threads_started":1}
I20260812 16:45:55.902444 21415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:55.902197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:54225)
0812 16:45:55.902362 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:55.902394 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":101,"threads_started":1}
I20260812 16:45:56.029556 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:56.029343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:37847)
0812 16:45:56.029473 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:56.029505 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260812 16:45:56.077180 21420 raft_consensus.cc:482] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:56.077292 21420 raft_consensus.cc:504] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44926fa259a4489c9f55d5807c8215a7" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37803 } } peers { permanent_uuid: "77477620e7f34338bb5816355a97d845" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38835 } } peers { permanent_uuid: "5703c58f8cf14b8384d99bdcbc6e0cfd" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 45203 } }
I20260812 16:45:56.077528 21420 leader_election.cc:288] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803), 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835)
W20260812 16:45:56.077984 20532 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44926fa259a4489c9f55d5807c8215a7 (127.21.114.66:37803): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
W20260812 16:45:56.078110 20536 leader_election.cc:341] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 77477620e7f34338bb5816355a97d845 (127.21.114.67:38835): Not found: Tablet not found: 5ace77f67135408ea3df553b530b3e71
I20260812 16:45:56.078194 20536 leader_election.cc:302] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703c58f8cf14b8384d99bdcbc6e0cfd; no voters: 44926fa259a4489c9f55d5807c8215a7, 77477620e7f34338bb5816355a97d845
I20260812 16:45:56.078293 21420 raft_consensus.cc:2726] T 5ace77f67135408ea3df553b530b3e71 P 5703c58f8cf14b8384d99bdcbc6e0cfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 16:45:56.820940 21423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:56.820691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.65:53109)
0812 16:45:56.820837 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:56.820890 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260812 16:45:56.903268 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:56.902984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.66:49103)
0812 16:45:56.903152 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:56.903214 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":84,"threads_started":1}
I20260812 16:45:57.029413 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 20424
I20260812 16:45:57.039093 21428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:57.037265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:35157 (local address 127.21.114.67:54833)
0812 16:45:57.038975 (+ 1710us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:57.039024 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.126:35157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1688,"thread_start_us":1633,"threads_started":1}
I20260812 16:45:57.046430 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 20766
I20260812 16:45:57.062088 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 21060
2026-08-12T16:45:57Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58741 ms)
[----------] 30 tests from SecurityITest (240466 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:45:57 dist-test-slave-45dx krb5kdc[21436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:45:57 dist-test-slave-45dx krb5kdc[21436](info): set up 2 sockets
Aug 12 16:45:57 dist-test-slave-45dx krb5kdc[21436](info): commencing operation
krb5kdc: starting...
W20260812 16:45:58.403971 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:45:58 dist-test-slave-45dx krb5kdc[21436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:45:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:45:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:45:58.538414 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37213
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:37213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:58.621618 21465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:58.621861 21465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:58.621886 21465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:58.622979 21465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:45:58.623013 21465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:58.623027 21465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:58.623039 21465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:45:58.623051 21465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:45:58.624471 21465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:37213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:58.624665 21465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:58.624856 21465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:58.630067 21473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:58.630122 21465 server_base.cc:1034] running on GCE node
W20260812 16:45:58.630100 21475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:58.630100 21478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:58.630601 21465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:58.630892 21465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:58.632064 21465 hybrid_clock.cc:648] HybridClock initialized: now 1786553158632051 us; error 32 us; skew 500 ppm
Aug 12 16:45:58 dist-test-slave-45dx krb5kdc[21436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:58.634690 21465 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:45:58.635174 21465 webserver.cc:460] Webserver started at http://127.21.114.126:35499/ using document root <none> and password file <none>
I20260812 16:45:58.635411 21465 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:58.635483 21465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:58.635633 21465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:58.636806 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "e1c7f1c8abb04f56b95a16c7ab901076"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "4dac9c0e757aa5f07d7557f83497de2d"
server_key_iv: "5973e8a46f44d455d22a6e359faa68ff"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.637188 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "e1c7f1c8abb04f56b95a16c7ab901076"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "4dac9c0e757aa5f07d7557f83497de2d"
server_key_iv: "5973e8a46f44d455d22a6e359faa68ff"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.638571 21465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:45:58.639406 21491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:58.639611 21465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:58.639751 21465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "e1c7f1c8abb04f56b95a16c7ab901076"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "4dac9c0e757aa5f07d7557f83497de2d"
server_key_iv: "5973e8a46f44d455d22a6e359faa68ff"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.639842 21465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:58.659447 21465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:58.661463 21465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:58.661641 21465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:58.665832 21465 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:37213
I20260812 16:45:58.665896 21599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:37213 every 8 connection(s)
I20260812 16:45:58.666268 21465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:45:58.667222 21600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:58.669638 21600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076: Bootstrap starting.
I20260812 16:45:58.670256 21600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:58.670572 21600 log.cc:824] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:58.671303 21600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076: No bootstrap required, opened a new log
I20260812 16:45:58.673002 21600 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37213 } }
I20260812 16:45:58.673142 21600 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:58.673188 21600 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c7f1c8abb04f56b95a16c7ab901076, State: Initialized, Role: FOLLOWER
I20260812 16:45:58.673367 21600 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37213 } }
I20260812 16:45:58.673452 21600 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:45:58.673504 21600 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:45:58.673555 21600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:58.674028 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 21465
I20260812 16:45:58.674144 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:45:58.674240 21600 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37213 } }
I20260812 16:45:58.674369 21961 external_mini_cluster.cc:1428] Setting key 6786b6245f508fda575f7dd21ebdf407
I20260812 16:45:58.674367 21600 leader_election.cc:302] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c7f1c8abb04f56b95a16c7ab901076; no voters:
I20260812 16:45:58.674561 21600 leader_election.cc:288] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:45:58.674707 21603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:45:58.674892 21600 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:45:58.674961 21603 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [term 1 LEADER]: Becoming Leader. State: Replica: e1c7f1c8abb04f56b95a16c7ab901076, State: Running, Role: LEADER
I20260812 16:45:58.675097 21603 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37213 } }
I20260812 16:45:58.675720 21605 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37213 } } }
I20260812 16:45:58.675805 21610 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c7f1c8abb04f56b95a16c7ab901076. Latest consensus state: current_term: 1 leader_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c7f1c8abb04f56b95a16c7ab901076" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37213 } } }
I20260812 16:45:58.675902 21610 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:58.675820 21605 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076 [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:58.676262 21624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:45:58.677033 21624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:45:58.678494 21624 catalog_manager.cc:1347] Generated new cluster ID: 702dae626daf45c1a7968d32d3c07d0a
I20260812 16:45:58.678548 21624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:45:58 dist-test-slave-45dx krb5kdc[21436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:58.684127 21624 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:45:58.684656 21624 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:45:58.692050 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:58.675067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40742 (local address 127.21.114.126:37213)
0812 16:45:58.675472 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:58.675483 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:58.675517 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:45:58.675641 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:58.675649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:58.675708 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:58.675846 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:58.676956 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:58.678334 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:58.679448 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:58.680082 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:58.680186 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:58.683119 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:58.683124 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:58.683124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:58.683137 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:58.690188 (+ 7051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:58.690636 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:58.690640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:58.690640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:58.690754 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:58.690970 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:58.690970 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:58.690971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:58.691238 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:58.691370 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:58.691634 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 16:45:58.691810 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":69,"threads_started":1}
I20260812 16:45:58.699484 21624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076: Generated new TSK 0
I20260812 16:45:58.699679 21624 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:45:58.727825 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37213
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:58.811827 21644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:58.812067 21644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:58.812106 21644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:58.813303 21644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:58.813381 21644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:58.813426 21644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:45:58.814904 21644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:58.815171 21644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:58.815416 21644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:58.820515 21656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:58.820550 21655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:58.820776 21644 server_base.cc:1034] running on GCE node
W20260812 16:45:58.820523 21662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:58.821246 21644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:58.821585 21644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:58.822762 21644 hybrid_clock.cc:648] HybridClock initialized: now 1786553158822738 us; error 39 us; skew 500 ppm
Aug 12 16:45:58 dist-test-slave-45dx krb5kdc[21436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:58.825261 21644 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:45:58.825706 21644 webserver.cc:460] Webserver started at http://127.21.114.65:40859/ using document root <none> and password file <none>
I20260812 16:45:58.825940 21644 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:58.826012 21644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:58.826166 21644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:58.827221 21644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "0bd27819a6ada24a74cbe49339af4973"
server_key_iv: "b72888fdd4fd57f94664d24961a702f4"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.827611 21644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "0bd27819a6ada24a74cbe49339af4973"
server_key_iv: "b72888fdd4fd57f94664d24961a702f4"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.829053 21644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 16:45:58.829774 21677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:58.829979 21644 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:58.830088 21644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "0bd27819a6ada24a74cbe49339af4973"
server_key_iv: "b72888fdd4fd57f94664d24961a702f4"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.830165 21644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:58.845260 21644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:58.847069 21644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:58.847237 21644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:58.847478 21644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:58.847801 21644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:58.847872 21644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:58.847915 21644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:58.847944 21644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:58.854135 21644 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:33393
I20260812 16:45:58.854188 21881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:33393 every 8 connection(s)
I20260812 16:45:58.854501 21644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
Aug 12 16:45:58 dist-test-slave-45dx krb5kdc[21436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:58.863313 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:58.855188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:43951 (local address 127.21.114.126:37213)
0812 16:45:58.855255 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:58.855257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:58.855498 (+ 241us) server_negotiation.cc:407] Connection header received
0812 16:45:58.855966 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:58.855967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:58.855977 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:58.856029 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:58.857002 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:58.857518 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:58.858462 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:58.858660 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:58.858710 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:58.860714 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:58.860715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:58.860715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:58.860722 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:58.862163 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:58.862523 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:58.862523 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:58.862524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:58.862578 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:58.862790 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:58.862790 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:58.862790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:58.862895 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:58.862944 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:58.863172 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 16:45:58.863246 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:45:58.863499 21888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:58.855162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37213 (local address 127.21.114.65:43951)
0812 16:45:58.855374 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:58.855410 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:58.855882 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:58.856083 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:58.856086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:58.856721 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:58.856918 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:58.856923 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:58.857602 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:58.857603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:58.858390 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:58.858392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:58.858735 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:58.858736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:58.858833 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:58.859261 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:58.859270 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:58.860622 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:58.862235 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:58.862241 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:58.862243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:58.862457 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:58.862635 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:58.862636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:58.862636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:58.862736 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:58.862949 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:58.862954 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:58.863065 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 16:45:58.863144 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 16:45:58.863262 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":121,"threads_started":1}
I20260812 16:45:58.863758 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 21644
I20260812 16:45:58.863900 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:45:58.864095 21886 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37213
I20260812 16:45:58.864167 21961 external_mini_cluster.cc:1428] Setting key 21f852338c8788605ee1ceb913856359
I20260812 16:45:58.864198 21886 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:58.864439 21886 heartbeater.cc:511] Master 127.21.114.126:37213 requested a full tablet report, sending...
I20260812 16:45:58.865026 21528 ts_manager.cc:194] Registered new tserver with Master: 17bdc65e46f04fb7a6e6b6bcff06a3f4 (127.21.114.65:33393)
I20260812 16:45:58.865633 21528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:43951
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:45:58.890595 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37213
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:58.974277 21892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:58.974546 21892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:58.974588 21892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:58.975889 21892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:58.975958 21892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:58.976002 21892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:45:58.977583 21892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:58.977874 21892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:58.978125 21892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:58.983542 21904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:58.983573 21901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:58.983747 21892 server_base.cc:1034] running on GCE node
W20260812 16:45:58.983773 21909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:58.984071 21892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:58.984385 21892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:58.985565 21892 hybrid_clock.cc:648] HybridClock initialized: now 1786553158985553 us; error 51 us; skew 500 ppm
Aug 12 16:45:58 dist-test-slave-45dx krb5kdc[21436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:58.988149 21892 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:45:58.988700 21892 webserver.cc:460] Webserver started at http://127.21.114.66:38043/ using document root <none> and password file <none>
I20260812 16:45:58.988967 21892 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:58.989041 21892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:58.989203 21892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:58.990262 21892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "4dc97b5cf9f44360afe995a97042c984"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "ca7fe2affc59fdeb79c460352453004f"
server_key_iv: "15ab8e300757a792604ff71f3377e97c"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.990638 21892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "4dc97b5cf9f44360afe995a97042c984"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "ca7fe2affc59fdeb79c460352453004f"
server_key_iv: "15ab8e300757a792604ff71f3377e97c"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.992074 21892 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:45:58.992965 21923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:58.993130 21892 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:45:58.993237 21892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "4dc97b5cf9f44360afe995a97042c984"
format_stamp: "Formatted at 2026-08-12 16:45:58 on dist-test-slave-45dx"
server_key: "ca7fe2affc59fdeb79c460352453004f"
server_key_iv: "15ab8e300757a792604ff71f3377e97c"
server_key_version: "encryptionkey@0"
I20260812 16:45:58.993330 21892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:58.999991 21892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:59.002053 21892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:59.002216 21892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:59.002437 21892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:59.002736 21892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:59.002792 21892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.002833 21892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:59.002861 21892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.008853 21892 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:36429
I20260812 16:45:59.008903 22165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:36429 every 8 connection(s)
I20260812 16:45:59.009258 21892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
Aug 12 16:45:59 dist-test-slave-45dx krb5kdc[21436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553158, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:59.015722 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 21892
I20260812 16:45:59.015834 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:45:59.016064 21961 external_mini_cluster.cc:1428] Setting key e055c885d673d7c153ee4a1f0e792a65
I20260812 16:45:59.019052 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.009952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:53503 (local address 127.21.114.126:37213)
0812 16:45:59.009997 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.010000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.010206 (+ 206us) server_negotiation.cc:407] Connection header received
0812 16:45:59.010738 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.010740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.010754 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.010812 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.011791 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.012349 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.013390 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.013592 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.013680 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.015972 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.015973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.015974 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:59.015981 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.017588 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:59.018019 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:59.018021 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:59.018021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:59.018089 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:59.018354 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:59.018355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:59.018356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:59.018485 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.018568 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.018852 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.018961 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:45:59.019227 22168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.009918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37213 (local address 127.21.114.66:53503)
0812 16:45:59.010069 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.010113 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.010626 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.010887 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.010891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.011485 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:59.011676 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.011681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.012460 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.012461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.013275 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.013277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.013691 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.013692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.013829 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.014298 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:59.014307 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:59.015850 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:59.017680 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:59.017687 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:59.017689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:59.017925 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:59.018168 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:59.018169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:59.018169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:59.018285 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:59.018558 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:59.018565 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:59.018710 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.018818 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.018981 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
I20260812 16:45:59.019860 22166 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37213
I20260812 16:45:59.019979 22166 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:59.020167 22166 heartbeater.cc:511] Master 127.21.114.126:37213 requested a full tablet report, sending...
I20260812 16:45:59.020623 21528 ts_manager.cc:194] Registered new tserver with Master: 4dc97b5cf9f44360afe995a97042c984 (127.21.114.66:36429)
I20260812 16:45:59.021024 21528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:53503
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:45:59.044296 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37213
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:45:59.127411 22173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:59.127664 22173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:59.127704 22173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:59.128871 22173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:59.128945 22173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:59.128989 22173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:45:59.130416 22173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:59.130685 22173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:59.130937 22173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:59.136133 22186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.136157 22188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.136152 22194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:59.138989 22173 server_base.cc:1034] running on GCE node
I20260812 16:45:59.139241 22173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:59.139508 22173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:59.140676 22173 hybrid_clock.cc:648] HybridClock initialized: now 1786553159140661 us; error 47 us; skew 500 ppm
Aug 12 16:45:59 dist-test-slave-45dx krb5kdc[21436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553159, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:45:59.143281 22173 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:45:59.143805 22173 webserver.cc:460] Webserver started at http://127.21.114.67:39569/ using document root <none> and password file <none>
I20260812 16:45:59.144073 22173 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:59.144145 22173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:59.144348 22173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:59.145439 22173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "5e52e5e3b04f44e5be4dff0fd5813106"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "b88bf399395d65e14248e0af58b168ac"
server_key_iv: "b777cb51b9212593f0f0e7841a0ee3be"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.145905 22173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "5e52e5e3b04f44e5be4dff0fd5813106"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "b88bf399395d65e14248e0af58b168ac"
server_key_iv: "b777cb51b9212593f0f0e7841a0ee3be"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.147347 22173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:45:59.148138 22208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.148505 22173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:45:59.148620 22173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "5e52e5e3b04f44e5be4dff0fd5813106"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "b88bf399395d65e14248e0af58b168ac"
server_key_iv: "b777cb51b9212593f0f0e7841a0ee3be"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.148703 22173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:59.183183 22173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:59.185485 22173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:59.185657 22173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:59.185912 22173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:59.186254 22173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:59.186312 22173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.186357 22173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:59.186389 22173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.192896 22173 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:39621
I20260812 16:45:59.192945 22415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:39621 every 8 connection(s)
I20260812 16:45:59.193279 22173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
Aug 12 16:45:59 dist-test-slave-45dx krb5kdc[21436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553159, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:45:59.199951 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22173
I20260812 16:45:59.200059 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:45:59.200279 21961 external_mini_cluster.cc:1428] Setting key 92a1d9b313774fcb6862ca85729b4286
I20260812 16:45:59.203018 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.194111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:36955 (local address 127.21.114.126:37213)
0812 16:45:59.194202 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.194204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.194383 (+ 179us) server_negotiation.cc:407] Connection header received
0812 16:45:59.194869 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.194871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.194881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.194935 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.195860 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.196516 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.197565 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.197751 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.197811 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.200269 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.200270 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.200270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:59.200277 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.201886 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:59.202254 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:59.202254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:59.202255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:59.202309 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:59.202493 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:59.202494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:59.202494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:59.202592 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.202642 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.202892 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.202955 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 16:45:59.203210 22419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.194071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37213 (local address 127.21.114.67:36955)
0812 16:45:59.194259 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.194296 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.194778 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.194991 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.194994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.195566 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:59.195788 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.195792 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.196599 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.196599 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.197492 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.197494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.197830 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.197830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.197957 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.198416 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:45:59.198425 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:59.200178 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:59.201958 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:59.201965 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:59.201967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:59.202186 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:59.202360 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:45:59.202361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:45:59.202361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:45:59.202445 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:45:59.202650 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:59.202655 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:59.202767 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.202849 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.202971 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":100,"threads_started":1}
I20260812 16:45:59.203677 22417 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37213
I20260812 16:45:59.203763 22417 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:59.203919 22417 heartbeater.cc:511] Master 127.21.114.126:37213 requested a full tablet report, sending...
I20260812 16:45:59.204246 21528 ts_manager.cc:194] Registered new tserver with Master: 5e52e5e3b04f44e5be4dff0fd5813106 (127.21.114.67:39621)
I20260812 16:45:59.204645 21528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:36955
I20260812 16:45:59.211983 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:45:59.219480 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.213371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.21.114.126:37213)
0812 16:45:59.213461 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.213464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.213582 (+ 118us) server_negotiation.cc:407] Connection header received
0812 16:45:59.213686 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.213687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.213704 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.213798 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.214376 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.214849 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.215591 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.215791 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.215866 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.217093 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.217094 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.217095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:45:59.217102 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.218273 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:59.218631 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:59.218633 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:59.218633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:59.218694 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:45:59.218910 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:45:59.218911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:45:59.218912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:45:59.219062 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.219174 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.219276 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.219365 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 16:45:59.221164 21528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:45:59.222765 21528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:45:59.229719 22438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.225181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:39621 (local address 127.0.0.1:55892)
0812 16:45:59.225506 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.225549 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.225614 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.225988 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.225992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.225994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.226065 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.226067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.227496 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.227497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.228630 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.228633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.229465 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.229465 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.229524 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.229527 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.229582 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.229619 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":32,"thread_start_us":70,"threads_started":1}
I20260812 16:45:59.229723 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.225302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55892 (local address 127.21.114.67:39621)
0812 16:45:59.225793 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.225798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.225808 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:45:59.225859 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.225861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.225877 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.226143 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.226243 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.227374 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.228702 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.229383 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.229452 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.229499 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.229596 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.229634 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":100,"threads_started":1}
I20260812 16:45:59.229808 22450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.225560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.21.114.65:33393)
0812 16:45:59.225762 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.225767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.225851 (+ 84us) server_negotiation.cc:407] Connection header received
0812 16:45:59.225925 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.225928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.225945 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.226023 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.226258 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.227386 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.228637 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.229162 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.229254 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.229318 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.229669 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.229719 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":95,"threads_started":1}
I20260812 16:45:59.229915 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.225404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.21.114.66:36429)
0812 16:45:59.225606 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.225612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.225734 (+ 122us) server_negotiation.cc:407] Connection header received
0812 16:45:59.226010 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.226013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.226027 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.226095 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.226281 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.227055 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.228529 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.229286 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.229362 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.229422 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.229768 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.229820 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":81,"threads_started":1}
I20260812 16:45:59.229616 22449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.225418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:33393 (local address 127.0.0.1:52342)
0812 16:45:59.225773 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.225790 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.225858 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.226110 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.226111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.226113 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.226193 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.226195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.227525 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.227526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.228548 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.228551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.229254 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.229255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.229342 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.229364 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.229466 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.229521 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":2,"thread_start_us":79,"threads_started":1}
I20260812 16:45:59.229725 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.225201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36429 (local address 127.0.0.1:35390)
0812 16:45:59.225664 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.225675 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.225916 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.226174 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.226175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.226177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.226207 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.226208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.227159 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.227160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.228444 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.228447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.229462 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.229464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.229531 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.229535 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.229585 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.229631 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":90,"threads_started":1}
I20260812 16:45:59.230904 22295 tablet_service.cc:1467] Processing CreateTablet for tablet 9930ae01b4bb4966a19ac8ca7f023822 (DEFAULT_TABLE table=test-table [id=733a54591803405fa8ac86811c1c806f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:59.230993 21764 tablet_service.cc:1467] Processing CreateTablet for tablet 9930ae01b4bb4966a19ac8ca7f023822 (DEFAULT_TABLE table=test-table [id=733a54591803405fa8ac86811c1c806f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:59.231158 22040 tablet_service.cc:1467] Processing CreateTablet for tablet 9930ae01b4bb4966a19ac8ca7f023822 (DEFAULT_TABLE table=test-table [id=733a54591803405fa8ac86811c1c806f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:59.231292 22295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9930ae01b4bb4966a19ac8ca7f023822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.231351 21764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9930ae01b4bb4966a19ac8ca7f023822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.231473 22040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9930ae01b4bb4966a19ac8ca7f023822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.234488 22451 tablet_bootstrap.cc:492] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: Bootstrap starting.
I20260812 16:45:59.234867 22455 tablet_bootstrap.cc:492] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Bootstrap starting.
I20260812 16:45:59.235332 22451 tablet_bootstrap.cc:654] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.235474 22455 tablet_bootstrap.cc:654] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.235877 22451 log.cc:824] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.235972 22455 log.cc:824] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.236353 22458 tablet_bootstrap.cc:492] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Bootstrap starting.
I20260812 16:45:59.236855 22451 tablet_bootstrap.cc:492] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: No bootstrap required, opened a new log
I20260812 16:45:59.236950 22451 ts_tablet_manager.cc:1397] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:45:59.237008 22458 tablet_bootstrap.cc:654] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.237471 22458 log.cc:824] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.238044 22455 tablet_bootstrap.cc:492] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: No bootstrap required, opened a new log
I20260812 16:45:59.238128 22455 ts_tablet_manager.cc:1397] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 16:45:59.238234 22458 tablet_bootstrap.cc:492] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: No bootstrap required, opened a new log
I20260812 16:45:59.238350 22458 ts_tablet_manager.cc:1397] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:45:59.238726 22451 raft_consensus.cc:348] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.238924 22451 raft_consensus.cc:374] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.238960 22451 raft_consensus.cc:729] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bdc65e46f04fb7a6e6b6bcff06a3f4, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.239136 22451 consensus_queue.cc:260] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.239431 22451 ts_tablet_manager.cc:1428] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 16:45:59.239554 21886 heartbeater.cc:503] Master 127.21.114.126:37213 was elected leader, sending a full tablet report...
I20260812 16:45:59.239897 22455 raft_consensus.cc:348] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.240083 22455 raft_consensus.cc:374] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.240170 22455 raft_consensus.cc:729] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e52e5e3b04f44e5be4dff0fd5813106, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.240317 22455 consensus_queue.cc:260] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.240474 22458 raft_consensus.cc:348] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.240614 22455 ts_tablet_manager.cc:1428] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 16:45:59.240624 22417 heartbeater.cc:503] Master 127.21.114.126:37213 was elected leader, sending a full tablet report...
I20260812 16:45:59.240675 22458 raft_consensus.cc:374] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.240749 22458 raft_consensus.cc:729] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc97b5cf9f44360afe995a97042c984, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.240903 22458 consensus_queue.cc:260] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.241199 22458 ts_tablet_manager.cc:1428] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:45:59.241220 22166 heartbeater.cc:503] Master 127.21.114.126:37213 was elected leader, sending a full tablet report...
W20260812 16:45:59.259830 22167 tablet.cc:2369] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:45:59.282265 22474 raft_consensus.cc:482] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:45:59.282459 22474 raft_consensus.cc:504] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.282886 22474 leader_election.cc:288] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e52e5e3b04f44e5be4dff0fd5813106 (127.21.114.67:39621), 17bdc65e46f04fb7a6e6b6bcff06a3f4 (127.21.114.65:33393)
I20260812 16:45:59.285739 22168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.283037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:39621 (local address 127.21.114.66:59629)
0812 16:45:59.283091 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.283104 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.283180 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.283342 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.283343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.283344 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.283420 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.283422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.284055 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.284057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.284901 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.284903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.285471 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.285472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.285556 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.285559 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.285622 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.285664 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 16:45:59.285739 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.283155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:59629 (local address 127.21.114.67:39621)
0812 16:45:59.283209 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.283212 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.283222 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:45:59.283252 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.283253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.283264 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.283325 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.283492 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.283970 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.284996 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.285381 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.285472 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.285482 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.285641 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.285677 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 16:45:59.285890 22475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.283158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:33393 (local address 127.21.114.66:43021)
0812 16:45:59.283371 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.283380 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.283457 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.283572 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.283573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.283574 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.283649 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.283655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.284275 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.284277 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.285038 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.285041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.285621 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.285622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.285700 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.285706 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.285773 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.285812 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":129,"threads_started":1}
I20260812 16:45:59.285902 22450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.283295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:43021 (local address 127.21.114.65:33393)
0812 16:45:59.283344 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.283346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.283444 (+ 98us) server_negotiation.cc:407] Connection header received
0812 16:45:59.283510 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.283511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.283521 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.283570 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.283718 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.284188 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.285135 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.285533 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.285619 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.285627 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.285792 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.285831 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:45:59.286208 22333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9930ae01b4bb4966a19ac8ca7f023822" candidate_uuid: "4dc97b5cf9f44360afe995a97042c984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" is_pre_election: true
I20260812 16:45:59.286290 21795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9930ae01b4bb4966a19ac8ca7f023822" candidate_uuid: "4dc97b5cf9f44360afe995a97042c984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" is_pre_election: true
I20260812 16:45:59.286352 22333 raft_consensus.cc:2454] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dc97b5cf9f44360afe995a97042c984 in term 0.
I20260812 16:45:59.286499 21795 raft_consensus.cc:2454] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dc97b5cf9f44360afe995a97042c984 in term 0.
I20260812 16:45:59.286612 21929 leader_election.cc:302] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dc97b5cf9f44360afe995a97042c984, 5e52e5e3b04f44e5be4dff0fd5813106; no voters:
I20260812 16:45:59.286763 22474 raft_consensus.cc:2781] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:45:59.286839 22474 raft_consensus.cc:482] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:45:59.286860 22474 raft_consensus.cc:3037] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:59.287606 22474 raft_consensus.cc:504] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.287741 22474 leader_election.cc:288] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [CANDIDATE]: Term 1 election: Requested vote from peers 5e52e5e3b04f44e5be4dff0fd5813106 (127.21.114.67:39621), 17bdc65e46f04fb7a6e6b6bcff06a3f4 (127.21.114.65:33393)
I20260812 16:45:59.287910 22333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9930ae01b4bb4966a19ac8ca7f023822" candidate_uuid: "4dc97b5cf9f44360afe995a97042c984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e52e5e3b04f44e5be4dff0fd5813106"
I20260812 16:45:59.287933 21795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9930ae01b4bb4966a19ac8ca7f023822" candidate_uuid: "4dc97b5cf9f44360afe995a97042c984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4"
I20260812 16:45:59.288004 22333 raft_consensus.cc:3037] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:59.288004 21795 raft_consensus.cc:3037] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:59.288753 21795 raft_consensus.cc:2454] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dc97b5cf9f44360afe995a97042c984 in term 1.
I20260812 16:45:59.288852 22333 raft_consensus.cc:2454] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dc97b5cf9f44360afe995a97042c984 in term 1.
I20260812 16:45:59.288932 21929 leader_election.cc:302] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bdc65e46f04fb7a6e6b6bcff06a3f4, 4dc97b5cf9f44360afe995a97042c984; no voters:
I20260812 16:45:59.289008 22474 raft_consensus.cc:2781] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:45:59.289173 22474 raft_consensus.cc:686] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 1 LEADER]: Becoming Leader. State: Replica: 4dc97b5cf9f44360afe995a97042c984, State: Running, Role: LEADER
I20260812 16:45:59.289286 22474 consensus_queue.cc:237] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } }
I20260812 16:45:59.290151 21528 catalog_manager.cc:5495] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dc97b5cf9f44360afe995a97042c984 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "4dc97b5cf9f44360afe995a97042c984" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dc97b5cf9f44360afe995a97042c984" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 36429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 } health_report { overall_health: UNKNOWN } } }
I20260812 16:45:59.301548 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.299410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35396 (local address 127.21.114.66:36429)
0812 16:45:59.299470 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.299472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.299480 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:45:59.299511 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.299512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.299527 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.299587 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:45:59.299699 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.300146 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.300910 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.301087 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.301140 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.301267 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:45:59.301367 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:45:59.301427 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.301462 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.301478 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:45:59.303319 22333 raft_consensus.cc:1261] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 1 FOLLOWER]: Refusing update from remote peer 4dc97b5cf9f44360afe995a97042c984: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:45:59.303319 21795 raft_consensus.cc:1261] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 1 FOLLOWER]: Refusing update from remote peer 4dc97b5cf9f44360afe995a97042c984: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:45:59.303691 22474 consensus_queue.cc:1035] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17bdc65e46f04fb7a6e6b6bcff06a3f4" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 33393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:45:59.303817 22477 consensus_queue.cc:1035] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e52e5e3b04f44e5be4dff0fd5813106" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:45:59.306999 22486 mvcc.cc:205] Tried to move back new op lower bound from 7317721740503470080 to 7317721740449579008. Current Snapshot: MvccSnapshot[applied={T|T < 7317721740503470080}]
I20260812 16:45:59.309387 21528 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:45:59.309478 21528 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:45:59.310281 21528 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1c7f1c8abb04f56b95a16c7ab901076: Sending DeleteTablet for 3 replicas of tablet 9930ae01b4bb4966a19ac8ca7f023822
I20260812 16:45:59.310607 22040 tablet_service.cc:1514] Processing DeleteTablet for tablet 9930ae01b4bb4966a19ac8ca7f023822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:59 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:35390
I20260812 16:45:59.310712 22295 tablet_service.cc:1514] Processing DeleteTablet for tablet 9930ae01b4bb4966a19ac8ca7f023822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:59 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:55892
I20260812 16:45:59.310940 22495 tablet_replica.cc:330] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: stopping tablet replica
I20260812 16:45:59.310961 21764 tablet_service.cc:1514] Processing DeleteTablet for tablet 9930ae01b4bb4966a19ac8ca7f023822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:45:59 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:52342
I20260812 16:45:59.311056 22495 raft_consensus.cc:2229] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:45:59.311173 22495 raft_consensus.cc:2258] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:59.311206 22496 tablet_replica.cc:330] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4: stopping tablet replica
I20260812 16:45:59.311295 22496 raft_consensus.cc:2229] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:45:59.311295 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 21644
I20260812 16:45:59.311400 22496 raft_consensus.cc:2258] T 9930ae01b4bb4966a19ac8ca7f023822 P 17bdc65e46f04fb7a6e6b6bcff06a3f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:59.312572 22495 ts_tablet_manager.cc:1905] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:45:59.315042 22495 ts_tablet_manager.cc:1918] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:45:59.315104 22495 log.cc:1196] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/9930ae01b4bb4966a19ac8ca7f023822
I20260812 16:45:59.315339 22495 ts_tablet_manager.cc:1939] T 9930ae01b4bb4966a19ac8ca7f023822 P 5e52e5e3b04f44e5be4dff0fd5813106: Deleting consensus metadata
I20260812 16:45:59.315697 21498 catalog_manager.cc:4841] TS 5e52e5e3b04f44e5be4dff0fd5813106 (127.21.114.67:39621): tablet 9930ae01b4bb4966a19ac8ca7f023822 (table test-table [id=733a54591803405fa8ac86811c1c806f]) successfully deleted
I20260812 16:45:59.323872 22494 tablet_replica.cc:330] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: stopping tablet replica
I20260812 16:45:59.324012 22494 raft_consensus.cc:2229] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:45:59.324193 22494 raft_consensus.cc:2258] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:45:59.328917 22494 ts_tablet_manager.cc:1905] T 9930ae01b4bb4966a19ac8ca7f023822 P 4dc97b5cf9f44360afe995a97042c984: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 16:45:59.329066 21498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:33393 (error 108)
I20260812 16:45:59.329375 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 21892
I20260812 16:45:59.334707 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.334542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:33393 (local address 127.0.0.1:52344)
0812 16:45:59.334615 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.334664 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 16:45:59.334858 21498 catalog_manager.cc:4584] TS 17bdc65e46f04fb7a6e6b6bcff06a3f4 (127.21.114.65:33393): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9930ae01b4bb4966a19ac8ca7f023822: Network error: Client connection negotiation failed: client connection to 127.21.114.65:33393: connect: Connection refused (error 111)
I20260812 16:45:59.338781 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22173
I20260812 16:45:59.338814 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.338679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:36429 (local address 127.0.0.1:35406)
0812 16:45:59.338740 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.338778 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.66:36429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 16:45:59.355403 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 21465
2026-08-12T16:45:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2294 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T16:45:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:45:59Z Disabled control of system clock
I20260812 16:45:59.396126 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37591
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:37591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:45:59.481781 22505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:59.482002 22505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:59.482023 22505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:59.483186 22505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:45:59.483229 22505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:59.483242 22505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:59.483291 22505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:45:59.483316 22505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:45:59.484735 22505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:37591
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:59.484993 22505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:59.485332 22505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:59.490224 22520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:59.490370 22505 server_base.cc:1034] running on GCE node
W20260812 16:45:59.490243 22512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.490253 22514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:59.490768 22505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:59.491122 22505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:59.492273 22505 hybrid_clock.cc:648] HybridClock initialized: now 1786553159492248 us; error 37 us; skew 500 ppm
I20260812 16:45:59.493659 22505 webserver.cc:460] Webserver started at http://127.21.114.126:35925/ using document root <none> and password file <none>
I20260812 16:45:59.493924 22505 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:59.493980 22505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:59.494141 22505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:59.495230 22505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "837fdd815ee0846788e5d72d073b287b"
server_key_iv: "ba7210683bdd4614a4551421cd572df3"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.495601 22505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "837fdd815ee0846788e5d72d073b287b"
server_key_iv: "ba7210683bdd4614a4551421cd572df3"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.496980 22505 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:45:59.497702 22531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.497910 22505 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:59.498006 22505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "837fdd815ee0846788e5d72d073b287b"
server_key_iv: "ba7210683bdd4614a4551421cd572df3"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.498082 22505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:59.511536 22505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:59.511853 22505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:59.512017 22505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:59.516161 22505 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:37591
I20260812 16:45:59.516218 22628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:37591 every 8 connection(s)
I20260812 16:45:59.516595 22505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:45:59.517628 22630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.520016 22630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf: Bootstrap starting.
I20260812 16:45:59.520756 22630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.520812 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22505
I20260812 16:45:59.520931 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:45:59.521140 22630 log.cc:824] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.521164 21961 external_mini_cluster.cc:1428] Setting key a955f7ab74caae4da2cffd072d110251
I20260812 16:45:59.521944 22630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf: No bootstrap required, opened a new log
I20260812 16:45:59.524084 22630 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37591 } }
I20260812 16:45:59.524246 22630 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.524293 22630 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d0dbfff0b74cdcb64214ff9b6280bf, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.524499 22630 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37591 } }
I20260812 16:45:59.524597 22630 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:45:59.524642 22630 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:45:59.524691 22630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:45:59.525388 22630 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37591 } }
I20260812 16:45:59.525511 22630 leader_election.cc:302] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6d0dbfff0b74cdcb64214ff9b6280bf; no voters:
I20260812 16:45:59.525689 22630 leader_election.cc:288] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:45:59.525755 22643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:45:59.525993 22643 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [term 1 LEADER]: Becoming Leader. State: Replica: a6d0dbfff0b74cdcb64214ff9b6280bf, State: Running, Role: LEADER
I20260812 16:45:59.526141 22643 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37591 } }
I20260812 16:45:59.526328 22630 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:45:59.526563 22647 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6d0dbfff0b74cdcb64214ff9b6280bf. Latest consensus state: current_term: 1 leader_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37591 } } }
I20260812 16:45:59.526782 22647 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:59.526703 22645 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d0dbfff0b74cdcb64214ff9b6280bf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37591 } } }
I20260812 16:45:59.527063 22645 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf [sys.catalog]: This master's current role is: LEADER
I20260812 16:45:59.527266 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.521706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.21.114.126:37591)
0812 16:45:59.521960 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.521968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.522012 (+ 44us) server_negotiation.cc:407] Connection header received
0812 16:45:59.522464 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.522470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.522526 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.522678 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.522905 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.523813 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.524803 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.525442 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.525574 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.526327 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.526331 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.526332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:45:59.526552 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.526597 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:45:59.526612 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.526677 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.526982 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.527071 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":79,"threads_started":1}
I20260812 16:45:59.527621 22657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:45:59.528551 22657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:45:59.530012 22657 catalog_manager.cc:1347] Generated new cluster ID: 46e8c0dafa7c48b18d861014c2990ce4
I20260812 16:45:59.530067 22657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:45:59.549049 22657 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:45:59.549787 22657 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:45:59.559866 22657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf: Generated new TSK 0
I20260812 16:45:59.560070 22657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:45:59.565780 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37591
--builtin_ntp_servers=127.21.114.84:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:45:59.651221 22686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:59.651470 22686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:59.651510 22686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:59.652733 22686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:59.652793 22686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:59.652833 22686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:45:59.654188 22686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:59.654464 22686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:59.654771 22686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:59.659878 22702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.659947 22693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.659897 22694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:59.660075 22686 server_base.cc:1034] running on GCE node
I20260812 16:45:59.660418 22686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:59.660646 22686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:59.661784 22686 hybrid_clock.cc:648] HybridClock initialized: now 1786553159661765 us; error 33 us; skew 500 ppm
I20260812 16:45:59.663089 22686 webserver.cc:460] Webserver started at http://127.21.114.65:35847/ using document root <none> and password file <none>
I20260812 16:45:59.663283 22686 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:59.663323 22686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:59.663439 22686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:59.664537 22686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "72913357ecb34d1988585c35dd21d2ee"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "d44521489acece03c36bc281d9e3a263"
server_key_iv: "ad4f59bbf95516396f603a69a3eb6a1f"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.664850 22686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "72913357ecb34d1988585c35dd21d2ee"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "d44521489acece03c36bc281d9e3a263"
server_key_iv: "ad4f59bbf95516396f603a69a3eb6a1f"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.666077 22686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:59.666718 22710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.666898 22686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:59.667001 22686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "72913357ecb34d1988585c35dd21d2ee"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "d44521489acece03c36bc281d9e3a263"
server_key_iv: "ad4f59bbf95516396f603a69a3eb6a1f"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.667088 22686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:59.687927 22686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:59.688253 22686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:59.688436 22686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:59.688676 22686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:59.689024 22686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:59.689081 22686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.689116 22686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:59.689141 22686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.695017 22686 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:42433
I20260812 16:45:59.695092 22926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:42433 every 8 connection(s)
I20260812 16:45:59.695433 22686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:45:59.700497 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.696243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53541 (local address 127.21.114.126:37591)
0812 16:45:59.696324 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.696326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.696537 (+ 211us) server_negotiation.cc:407] Connection header received
0812 16:45:59.697012 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.697013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.697023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.697085 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.697746 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.698237 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.699178 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.699377 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.699427 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.700203 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.700204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.700205 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:45:59.700209 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.700222 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:45:59.700225 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.700269 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.700411 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.700438 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 16:45:59.700709 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.696198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37591 (local address 127.21.114.65:53541)
0812 16:45:59.696400 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.696442 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.696925 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.697159 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.697163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.697171 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:59.697672 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.697676 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.698321 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.698321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.699100 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.699102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.699455 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.699456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.699567 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.700070 (+ 503us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:45:59.700070 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:59.700097 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:45:59.700118 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:59.700280 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:59.700284 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:59.700287 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.700405 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.700491 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260812 16:45:59.701259 22927 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37591
I20260812 16:45:59.701380 22927 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:59.701566 22927 heartbeater.cc:511] Master 127.21.114.126:37591 requested a full tablet report, sending...
I20260812 16:45:59.701856 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22686
I20260812 16:45:59.701959 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:45:59.702162 21961 external_mini_cluster.cc:1428] Setting key fe6f0b62b0e4e429e941e8abf3c98849
I20260812 16:45:59.702152 22564 ts_manager.cc:194] Registered new tserver with Master: 72913357ecb34d1988585c35dd21d2ee (127.21.114.65:42433)
I20260812 16:45:59.702893 22564 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.65:53541
I20260812 16:45:59.703367 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37591
--builtin_ntp_servers=127.21.114.84:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:45:59.786052 22931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:59.786280 22931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:59.786319 22931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:59.787451 22931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:59.787516 22931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:59.787557 22931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:45:59.788995 22931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:59.789260 22931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:59.789574 22931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:59.794627 22948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.794591 22946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.794625 22944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:59.794902 22931 server_base.cc:1034] running on GCE node
I20260812 16:45:59.795116 22931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:59.795387 22931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:59.796554 22931 hybrid_clock.cc:648] HybridClock initialized: now 1786553159796550 us; error 38 us; skew 500 ppm
I20260812 16:45:59.797814 22931 webserver.cc:460] Webserver started at http://127.21.114.66:43955/ using document root <none> and password file <none>
I20260812 16:45:59.798089 22931 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:59.798161 22931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:59.798318 22931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:59.799364 22931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "3433408b47a54c619b03b69babedfeba"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "e80d6f9f641a6faa68199dc1144d238b"
server_key_iv: "ea5b7483744a978bda301609e4895846"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.799744 22931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "3433408b47a54c619b03b69babedfeba"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "e80d6f9f641a6faa68199dc1144d238b"
server_key_iv: "ea5b7483744a978bda301609e4895846"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.801148 22931 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:45:59.801879 22957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.802052 22931 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:45:59.802160 22931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "3433408b47a54c619b03b69babedfeba"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "e80d6f9f641a6faa68199dc1144d238b"
server_key_iv: "ea5b7483744a978bda301609e4895846"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.802234 22931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:59.815591 22931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:59.815963 22931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:59.816131 22931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:59.816427 22931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:59.816783 22931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:59.816843 22931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.816886 22931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:59.816915 22931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.822789 22931 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:38079
I20260812 16:45:59.822830 23182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:38079 every 8 connection(s)
I20260812 16:45:59.823197 22931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:45:59.828814 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 22931
I20260812 16:45:59.828958 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:45:59.829025 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.824035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:60807 (local address 127.21.114.126:37591)
0812 16:45:59.824127 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.824130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.824407 (+ 277us) server_negotiation.cc:407] Connection header received
0812 16:45:59.824973 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.824975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.824988 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.825050 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.825770 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.826273 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.827439 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.827693 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.827785 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.828682 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.828683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.828684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:45:59.828688 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.828704 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:45:59.828708 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.828758 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.828875 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.828923 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 16:45:59.829175 21961 external_mini_cluster.cc:1428] Setting key c22745b54e3045804233b7eb3e6709a1
I20260812 16:45:59.829234 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.824004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37591 (local address 127.21.114.66:60807)
0812 16:45:59.824228 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.824282 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.824861 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.825121 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.825125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.825135 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:59.825667 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.825672 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.826390 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.826391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.827348 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.827350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.827796 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.827797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.827931 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.828498 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:45:59.828498 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:59.828528 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:45:59.828552 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:59.828782 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:59.828788 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:59.828792 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.828871 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.828994 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":97,"threads_started":1}
I20260812 16:45:59.829669 23184 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37591
I20260812 16:45:59.829762 23184 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:59.829962 23184 heartbeater.cc:511] Master 127.21.114.126:37591 requested a full tablet report, sending...
I20260812 16:45:59.830319 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37591
--builtin_ntp_servers=127.21.114.84:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 16:45:59.830387 22563 ts_manager.cc:194] Registered new tserver with Master: 3433408b47a54c619b03b69babedfeba (127.21.114.66:38079)
I20260812 16:45:59.830790 22563 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.66:60807
W20260812 16:45:59.914076 23191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:45:59.914284 23191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:45:59.914305 23191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:45:59.915452 23191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:45:59.915496 23191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:45:59.915521 23191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:45:59.916898 23191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:45:59.917140 23191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:45:59.917451 23191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:45:59.922387 23206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.922384 23201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:45:59.922417 23203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:45:59.922614 23191 server_base.cc:1034] running on GCE node
I20260812 16:45:59.922883 23191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:45:59.923128 23191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:45:59.924335 23191 hybrid_clock.cc:648] HybridClock initialized: now 1786553159924283 us; error 31 us; skew 500 ppm
I20260812 16:45:59.925608 23191 webserver.cc:460] Webserver started at http://127.21.114.67:36469/ using document root <none> and password file <none>
I20260812 16:45:59.925866 23191 fs_manager.cc:359] Metadata directory not provided
I20260812 16:45:59.925940 23191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:45:59.926083 23191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:45:59.927318 23191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "57168636de69488b9f813fd50ded229b"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "8e18496afb38f224a6cc3d54aa230113"
server_key_iv: "1029148c378e1a9752bdc8ac12269fb2"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.927757 23191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "57168636de69488b9f813fd50ded229b"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "8e18496afb38f224a6cc3d54aa230113"
server_key_iv: "1029148c378e1a9752bdc8ac12269fb2"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.929220 23191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:45:59.930030 23213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.930228 23191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:45:59.930341 23191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "57168636de69488b9f813fd50ded229b"
format_stamp: "Formatted at 2026-08-12 16:45:59 on dist-test-slave-45dx"
server_key: "8e18496afb38f224a6cc3d54aa230113"
server_key_iv: "1029148c378e1a9752bdc8ac12269fb2"
server_key_version: "encryptionkey@0"
I20260812 16:45:59.930428 23191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:45:59.942554 23191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:45:59.942867 23191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:45:59.943028 23191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:45:59.943261 23191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:45:59.943605 23191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:45:59.943663 23191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.943704 23191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:45:59.943733 23191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:45:59.949678 23191 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:44429
I20260812 16:45:59.949720 23432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:44429 every 8 connection(s)
I20260812 16:45:59.950081 23191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:45:59.955099 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.950823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:43929 (local address 127.21.114.126:37591)
0812 16:45:59.950909 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.950911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.951144 (+ 233us) server_negotiation.cc:407] Connection header received
0812 16:45:59.951624 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.951625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.951636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.951688 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.952399 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.952896 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.953840 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.954030 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.954085 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.954863 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.954864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.954865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:45:59.954869 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.954883 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:45:59.954886 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.954932 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.955014 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.955037 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 16:45:59.955286 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.950823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37591 (local address 127.21.114.67:43929)
0812 16:45:59.951015 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.951050 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.951537 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.951750 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.951753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.951761 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:45:59.952269 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.952274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.952979 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.952980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.953758 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.953760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.954108 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.954109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.954216 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.954722 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:45:59.954722 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:45:59.954752 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:45:59.954775 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:45:59.954943 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:45:59.954948 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:45:59.954950 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.955000 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.955078 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260812 16:45:59.955797 23433 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37591
I20260812 16:45:59.955917 23433 heartbeater.cc:464] Registering TS with master...
I20260812 16:45:59.956019 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23191
I20260812 16:45:59.956148 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:45:59.956144 23433 heartbeater.cc:511] Master 127.21.114.126:37591 requested a full tablet report, sending...
I20260812 16:45:59.956383 21961 external_mini_cluster.cc:1428] Setting key a4326340d112d80e8ce6177e80092b39
I20260812 16:45:59.956661 22563 ts_manager.cc:194] Registered new tserver with Master: 57168636de69488b9f813fd50ded229b (127.21.114.67:44429)
I20260812 16:45:59.957161 22563 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.67:43929
I20260812 16:45:59.957295 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:45:59.961413 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.958802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58260 (local address 127.21.114.126:37591)
0812 16:45:59.958864 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.958866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.958994 (+ 128us) server_negotiation.cc:407] Connection header received
0812 16:45:59.959050 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.959050 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.959059 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.959098 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:45:59.959225 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.959677 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.960441 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.960611 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.960660 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.961225 (+ 565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:45:59.961226 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:45:59.961226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:45:59.961230 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:45:59.961242 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:45:59.961246 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:45:59.961288 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.961338 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.961363 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:45:59.962869 22563 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:45:59.964399 22563 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:45:59.971031 23443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.966604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:44429 (local address 127.0.0.1:54312)
0812 16:45:59.967154 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.967164 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.967218 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.967551 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.967552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.967554 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.967600 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.967602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.968795 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.968797 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.969792 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.969795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.970703 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.970778 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.970791 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.970871 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.970925 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":413,"thread_start_us":74,"threads_started":1}
I20260812 16:45:59.971174 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.966865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41404 (local address 127.21.114.66:38079)
0812 16:45:59.967038 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.967043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.967268 (+ 225us) server_negotiation.cc:407] Connection header received
0812 16:45:59.967421 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.967423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.967441 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.967491 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.967710 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.968490 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970126 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.970638 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970738 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.970836 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.971027 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.971076 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260812 16:45:59.971174 23445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.966692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49096 (local address 127.21.114.65:42433)
0812 16:45:59.967005 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.967009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.967017 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:45:59.967047 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.967048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.967060 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.967150 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.967314 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.968481 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970079 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.970769 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970837 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.970918 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.971038 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.971094 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":96,"threads_started":1}
I20260812 16:45:59.971540 23444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.966692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54312 (local address 127.21.114.67:44429)
0812 16:45:59.967341 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0812 16:45:59.967346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:45:59.967355 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:45:59.967393 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:45:59.967394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:45:59.967410 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:45:59.967486 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:45:59.967687 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.968707 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.969884 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.970606 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970686 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.970778 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 16:45:59.971434 (+ 656us) server_negotiation.cc:299] Negotiation successful
0812 16:45:59.971474 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":74,"threads_started":1}
I20260812 16:45:59.971155 23442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.966604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:42433 (local address 127.0.0.1:49096)
0812 16:45:59.966768 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.966807 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.966893 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.967156 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.967159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.967161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.967227 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.967229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.968572 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.968573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.970000 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.970004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.970839 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.970918 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.970923 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.970983 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.971034 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":68,"thread_start_us":55,"threads_started":1}
I20260812 16:45:59.971395 23448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:45:59.966604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:38079 (local address 127.0.0.1:41404)
0812 16:45:59.967139 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 16:45:59.967151 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:45:59.967299 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:45:59.967577 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:45:59.967577 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:45:59.967579 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:45:59.967608 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.967619 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.968603 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.968604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.970026 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:45:59.970028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:45:59.970872 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:45:59.970873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:45:59.970932 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:45:59.970935 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:45:59.971249 (+ 314us) client_negotiation.cc:240] Negotiation successful
0812 16:45:59.971288 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":107,"thread_start_us":103,"threads_started":1}
I20260812 16:45:59.972507 22792 tablet_service.cc:1467] Processing CreateTablet for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b (DEFAULT_TABLE table=test-table [id=7390476f65ee42c0abec0319026d8dc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:59.972486 23055 tablet_service.cc:1467] Processing CreateTablet for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b (DEFAULT_TABLE table=test-table [id=7390476f65ee42c0abec0319026d8dc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:59.972733 23300 tablet_service.cc:1467] Processing CreateTablet for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b (DEFAULT_TABLE table=test-table [id=7390476f65ee42c0abec0319026d8dc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:45:59.972882 22792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.972882 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.973104 23300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:45:59.975999 23449 tablet_bootstrap.cc:492] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Bootstrap starting.
I20260812 16:45:59.976257 23451 tablet_bootstrap.cc:492] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: Bootstrap starting.
I20260812 16:45:59.976257 23450 tablet_bootstrap.cc:492] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Bootstrap starting.
I20260812 16:45:59.976723 23449 tablet_bootstrap.cc:654] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.976991 23451 tablet_bootstrap.cc:654] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.976990 23450 tablet_bootstrap.cc:654] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Neither blocks nor log segments found. Creating new log.
I20260812 16:45:59.977067 23449 log.cc:824] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.977330 23451 log.cc:824] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.977330 23450 log.cc:824] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Log is configured to *not* fsync() on all Append() calls
I20260812 16:45:59.977825 23449 tablet_bootstrap.cc:492] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: No bootstrap required, opened a new log
I20260812 16:45:59.977900 23449 ts_tablet_manager.cc:1397] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:45:59.978080 23450 tablet_bootstrap.cc:492] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: No bootstrap required, opened a new log
I20260812 16:45:59.978145 23450 ts_tablet_manager.cc:1397] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:45:59.978210 23451 tablet_bootstrap.cc:492] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: No bootstrap required, opened a new log
I20260812 16:45:59.978256 23451 ts_tablet_manager.cc:1397] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:45:59.979970 23451 raft_consensus.cc:348] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:45:59.980093 23451 raft_consensus.cc:374] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.980113 23451 raft_consensus.cc:729] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72913357ecb34d1988585c35dd21d2ee, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.980232 23451 consensus_queue.cc:260] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:45:59.980541 23451 ts_tablet_manager.cc:1428] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260812 16:45:59.980683 22927 heartbeater.cc:503] Master 127.21.114.126:37591 was elected leader, sending a full tablet report...
I20260812 16:45:59.980648 23450 raft_consensus.cc:348] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:45:59.980648 23449 raft_consensus.cc:348] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:45:59.980796 23450 raft_consensus.cc:374] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.980798 23449 raft_consensus.cc:374] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:45:59.980832 23449 raft_consensus.cc:729] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57168636de69488b9f813fd50ded229b, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.980832 23450 raft_consensus.cc:729] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3433408b47a54c619b03b69babedfeba, State: Initialized, Role: FOLLOWER
I20260812 16:45:59.980953 23449 consensus_queue.cc:260] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:45:59.980944 23450 consensus_queue.cc:260] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:45:59.981201 23450 ts_tablet_manager.cc:1428] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:45:59.981201 23449 ts_tablet_manager.cc:1428] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:45:59.981352 23433 heartbeater.cc:503] Master 127.21.114.126:37591 was elected leader, sending a full tablet report...
I20260812 16:45:59.981415 23184 heartbeater.cc:503] Master 127.21.114.126:37591 was elected leader, sending a full tablet report...
W20260812 16:46:00.073794 23186 tablet.cc:2369] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:46:00.196285 22928 tablet.cc:2369] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:46:00.200632 23434 tablet.cc:2369] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:00.236524 23459 raft_consensus.cc:482] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:46:00.236716 23459 raft_consensus.cc:504] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:46:00.237121 23459 leader_election.cc:288] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72913357ecb34d1988585c35dd21d2ee (127.21.114.65:42433), 57168636de69488b9f813fd50ded229b (127.21.114.67:44429)
I20260812 16:46:00.241082 23445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:00.237461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:57315 (local address 127.21.114.65:42433)
0812 16:46:00.237512 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:00.237515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:00.237528 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:46:00.237560 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:00.237561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:00.237571 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:00.237654 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:00.237850 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.238664 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.240117 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.240695 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.240773 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:00.240782 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:00.240965 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 16:46:00.241006 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:46:00.241082 23444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:00.237438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:58143 (local address 127.21.114.67:44429)
0812 16:46:00.237482 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:00.237484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:00.237750 (+ 266us) server_negotiation.cc:407] Connection header received
0812 16:46:00.237782 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:00.237783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:00.237790 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:00.237883 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:00.238028 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.238696 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.240117 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.240695 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.240773 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:00.240782 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:00.240965 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 16:46:00.241006 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:46:00.241079 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:00.237331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:42433 (local address 127.21.114.66:57315)
0812 16:46:00.237400 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:00.237414 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:00.237486 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:00.237675 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:00.237676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:00.237678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:00.237763 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:00.237765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.238768 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.238769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:00.240012 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:00.240016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.240787 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.240788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:00.240866 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:00.240872 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:46:00.240936 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 16:46:00.240981 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":8}
I20260812 16:46:00.241089 23466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:00.237331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:44429 (local address 127.21.114.66:58143)
0812 16:46:00.237664 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:00.237675 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:00.237734 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:00.237906 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:00.237906 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:00.237908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:00.237958 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:00.237959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.238768 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.238769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:00.240016 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:00.240017 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.240789 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.240790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:00.240882 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:00.240886 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:00.240938 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:46:00.240981 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":141,"thread_start_us":116,"threads_started":1}
I20260812 16:46:00.241494 23341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9e6a108d8a4ed2b2ac8cbe73a1915b" candidate_uuid: "3433408b47a54c619b03b69babedfeba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57168636de69488b9f813fd50ded229b" is_pre_election: true
I20260812 16:46:00.241474 22846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9e6a108d8a4ed2b2ac8cbe73a1915b" candidate_uuid: "3433408b47a54c619b03b69babedfeba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72913357ecb34d1988585c35dd21d2ee" is_pre_election: true
I20260812 16:46:00.241655 23341 raft_consensus.cc:2454] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3433408b47a54c619b03b69babedfeba in term 0.
I20260812 16:46:00.241671 22846 raft_consensus.cc:2454] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3433408b47a54c619b03b69babedfeba in term 0.
I20260812 16:46:00.241940 22961 leader_election.cc:302] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3433408b47a54c619b03b69babedfeba, 57168636de69488b9f813fd50ded229b; no voters:
I20260812 16:46:00.242144 23459 raft_consensus.cc:2781] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:46:00.242201 23459 raft_consensus.cc:482] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:46:00.242218 23459 raft_consensus.cc:3037] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:00.242960 23459 raft_consensus.cc:504] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:46:00.243105 23459 leader_election.cc:288] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [CANDIDATE]: Term 1 election: Requested vote from peers 72913357ecb34d1988585c35dd21d2ee (127.21.114.65:42433), 57168636de69488b9f813fd50ded229b (127.21.114.67:44429)
I20260812 16:46:00.243265 23341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9e6a108d8a4ed2b2ac8cbe73a1915b" candidate_uuid: "3433408b47a54c619b03b69babedfeba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57168636de69488b9f813fd50ded229b"
I20260812 16:46:00.243265 22846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba9e6a108d8a4ed2b2ac8cbe73a1915b" candidate_uuid: "3433408b47a54c619b03b69babedfeba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72913357ecb34d1988585c35dd21d2ee"
I20260812 16:46:00.243346 22846 raft_consensus.cc:3037] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:00.243346 23341 raft_consensus.cc:3037] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:00.244277 23341 raft_consensus.cc:2454] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3433408b47a54c619b03b69babedfeba in term 1.
I20260812 16:46:00.244289 22846 raft_consensus.cc:2454] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3433408b47a54c619b03b69babedfeba in term 1.
I20260812 16:46:00.244493 22968 leader_election.cc:302] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3433408b47a54c619b03b69babedfeba, 72913357ecb34d1988585c35dd21d2ee; no voters:
I20260812 16:46:00.244623 23459 raft_consensus.cc:2781] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:00.244808 23459 raft_consensus.cc:686] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 1 LEADER]: Becoming Leader. State: Replica: 3433408b47a54c619b03b69babedfeba, State: Running, Role: LEADER
I20260812 16:46:00.244927 23459 consensus_queue.cc:237] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } }
I20260812 16:46:00.245785 22560 catalog_manager.cc:5495] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba reported cstate change: term changed from 0 to 1, leader changed from <none> to 3433408b47a54c619b03b69babedfeba (127.21.114.66). New cstate: current_term: 1 leader_uuid: "3433408b47a54c619b03b69babedfeba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3433408b47a54c619b03b69babedfeba" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 } health_report { overall_health: UNKNOWN } } }
I20260812 16:46:00.256332 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:00.253863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41416 (local address 127.21.114.66:38079)
0812 16:46:00.253918 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:00.253920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:00.253958 (+ 38us) server_negotiation.cc:407] Connection header received
0812 16:46:00.254050 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:00.254051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:00.254070 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:00.254155 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:00.254260 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.254732 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.255490 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:00.255690 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:00.255767 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:00.255944 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:00.256048 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:00.256143 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:00.256169 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 16:46:00.256187 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 16:46:00.258317 22846 raft_consensus.cc:1261] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 1 FOLLOWER]: Refusing update from remote peer 3433408b47a54c619b03b69babedfeba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:00.258378 23341 raft_consensus.cc:1261] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 1 FOLLOWER]: Refusing update from remote peer 3433408b47a54c619b03b69babedfeba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:00.258795 23459 consensus_queue.cc:1035] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [LEADER]: Connected to new peer: Peer: permanent_uuid: "57168636de69488b9f813fd50ded229b" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 44429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:00.258930 23468 consensus_queue.cc:1035] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [LEADER]: Connected to new peer: Peer: permanent_uuid: "72913357ecb34d1988585c35dd21d2ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 42433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:00.262334 23479 mvcc.cc:205] Tried to move back new op lower bound from 7317721744415043584 to 7317721744363819008. Current Snapshot: MvccSnapshot[applied={T|T < 7317721744415043584 or (T in {7317721744415043584})}]
I20260812 16:46:00.265990 23478 mvcc.cc:205] Tried to move back new op lower bound from 7317721744415043584 to 7317721744363819008. Current Snapshot: MvccSnapshot[applied={T|T < 7317721744415043584}]
I20260812 16:46:00.266412 22563 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:00.266508 22563 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:00.267408 22563 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6d0dbfff0b74cdcb64214ff9b6280bf: Sending DeleteTablet for 3 replicas of tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b
I20260812 16:46:00.267951 22792 tablet_service.cc:1514] Processing DeleteTablet for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:00 UTC) from {username='slave'} at 127.0.0.1:49096
I20260812 16:46:00.267921 23300 tablet_service.cc:1514] Processing DeleteTablet for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:00 UTC) from {username='slave'} at 127.0.0.1:54312
I20260812 16:46:00.268366 23491 tablet_replica.cc:330] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee: stopping tablet replica
I20260812 16:46:00.268364 23495 tablet_replica.cc:330] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: stopping tablet replica
I20260812 16:46:00.268528 23495 raft_consensus.cc:2229] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:00.268541 23491 raft_consensus.cc:2229] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:00.268664 23491 raft_consensus.cc:2258] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 72913357ecb34d1988585c35dd21d2ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:00.268784 23495 raft_consensus.cc:2258] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:00.269338 23495 ts_tablet_manager.cc:1905] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:00.269403 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:00 UTC) from {username='slave'} at 127.0.0.1:41404
I20260812 16:46:00.269634 23496 tablet_replica.cc:330] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: stopping tablet replica
I20260812 16:46:00.269737 23496 raft_consensus.cc:2229] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:46:00.269835 23496 raft_consensus.cc:2258] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:00.270123 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22686
I20260812 16:46:00.271534 23495 ts_tablet_manager.cc:1918] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:00.271678 23495 log.cc:1196] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/ba9e6a108d8a4ed2b2ac8cbe73a1915b
I20260812 16:46:00.272030 23495 ts_tablet_manager.cc:1939] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 57168636de69488b9f813fd50ded229b: Deleting consensus metadata
I20260812 16:46:00.273483 22535 catalog_manager.cc:4841] TS 57168636de69488b9f813fd50ded229b (127.21.114.67:44429): tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b (table test-table [id=7390476f65ee42c0abec0319026d8dc4]) successfully deleted
I20260812 16:46:00.273731 23496 ts_tablet_manager.cc:1905] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:00.275876 23496 ts_tablet_manager.cc:1918] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:00.275974 23496 log.cc:1196] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/ba9e6a108d8a4ed2b2ac8cbe73a1915b
I20260812 16:46:00.276288 23496 ts_tablet_manager.cc:1939] T ba9e6a108d8a4ed2b2ac8cbe73a1915b P 3433408b47a54c619b03b69babedfeba: Deleting consensus metadata
I20260812 16:46:00.276791 22533 catalog_manager.cc:4841] TS 3433408b47a54c619b03b69babedfeba (127.21.114.66:38079): tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b (table test-table [id=7390476f65ee42c0abec0319026d8dc4]) successfully deleted
W20260812 16:46:00.284349 22539 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:42433 (error 108)
I20260812 16:46:00.284605 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22931
I20260812 16:46:00.291021 23443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:00.284742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:42433 (local address 127.0.0.1:49100)
0812 16:46:00.290933 (+ 6191us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:00.290987 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:42433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6166}
W20260812 16:46:00.292485 22539 catalog_manager.cc:4584] TS 72913357ecb34d1988585c35dd21d2ee (127.21.114.65:42433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba9e6a108d8a4ed2b2ac8cbe73a1915b: Network error: Client connection negotiation failed: client connection to 127.21.114.65:42433: connect: Connection refused (error 111)
I20260812 16:46:00.305258 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23191
I20260812 16:46:00.318683 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 22505
2026-08-12T16:46:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (954 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:00 dist-test-slave-45dx krb5kdc[23502](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:00 dist-test-slave-45dx krb5kdc[23502](info): set up 2 sockets
Aug 12 16:46:00 dist-test-slave-45dx krb5kdc[23502](info): commencing operation
krb5kdc: starting...
W20260812 16:46:01.625801 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:01 dist-test-slave-45dx krb5kdc[23502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:01.748562 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37063
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:37063
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:01.831799 23526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:01.832026 23526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:01.832052 23526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:01.833241 23526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:01.833287 23526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:01.833302 23526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:01.833314 23526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:01.833382 23526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:01.834848 23526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:37063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:01.835115 23526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:01.835407 23526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:01.840291 23538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:01.840276 23541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:01.840292 23539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:01.840308 23526 server_base.cc:1034] running on GCE node
I20260812 16:46:01.840884 23526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:01.841178 23526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:01.842319 23526 hybrid_clock.cc:648] HybridClock initialized: now 1786553161842307 us; error 32 us; skew 500 ppm
Aug 12 16:46:01 dist-test-slave-45dx krb5kdc[23502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553161, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:01.844964 23526 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:01.845425 23526 webserver.cc:460] Webserver started at http://127.21.114.126:39909/ using document root <none> and password file <none>
I20260812 16:46:01.845624 23526 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:01.845665 23526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:01.845757 23526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:01.846742 23526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "77c13ac457c3479da49c3a4ce67dbadf"
format_stamp: "Formatted at 2026-08-12 16:46:01 on dist-test-slave-45dx"
server_key: "fc22859dba50a1359d3545adda00621f"
server_key_iv: "b9d34a4e374b2a981cdda878cd4aacb4"
server_key_version: "encryptionkey@0"
I20260812 16:46:01.847060 23526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "77c13ac457c3479da49c3a4ce67dbadf"
format_stamp: "Formatted at 2026-08-12 16:46:01 on dist-test-slave-45dx"
server_key: "fc22859dba50a1359d3545adda00621f"
server_key_iv: "b9d34a4e374b2a981cdda878cd4aacb4"
server_key_version: "encryptionkey@0"
I20260812 16:46:01.848393 23526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:46:01.849110 23552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:01.849269 23526 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:01.849359 23526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "77c13ac457c3479da49c3a4ce67dbadf"
format_stamp: "Formatted at 2026-08-12 16:46:01 on dist-test-slave-45dx"
server_key: "fc22859dba50a1359d3545adda00621f"
server_key_iv: "b9d34a4e374b2a981cdda878cd4aacb4"
server_key_version: "encryptionkey@0"
I20260812 16:46:01.849422 23526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:01.874997 23526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:01.877022 23526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:01.877143 23526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:01.881141 23526 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:37063
I20260812 16:46:01.881202 23648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:37063 every 8 connection(s)
I20260812 16:46:01.881588 23526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:01.882548 23650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:01.883662 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23526
I20260812 16:46:01.883797 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:01.883984 21961 external_mini_cluster.cc:1428] Setting key d608afb7907a8b1fb71f6f87f02a4835
I20260812 16:46:01.885551 23650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf: Bootstrap starting.
I20260812 16:46:01.886212 23650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:01.886555 23650 log.cc:824] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:01.887341 23650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf: No bootstrap required, opened a new log
I20260812 16:46:01.889555 23650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c13ac457c3479da49c3a4ce67dbadf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37063 } }
I20260812 16:46:01.889690 23650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:01.889714 23650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c13ac457c3479da49c3a4ce67dbadf, State: Initialized, Role: FOLLOWER
I20260812 16:46:01.889850 23650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c13ac457c3479da49c3a4ce67dbadf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37063 } }
I20260812 16:46:01.889928 23650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:01.889951 23650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:01.890021 23650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:01.890573 23650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c13ac457c3479da49c3a4ce67dbadf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37063 } }
I20260812 16:46:01.890695 23650 leader_election.cc:302] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77c13ac457c3479da49c3a4ce67dbadf; no voters:
I20260812 16:46:01.890913 23650 leader_election.cc:288] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:01.890940 23659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:01.891062 23659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [term 1 LEADER]: Becoming Leader. State: Replica: 77c13ac457c3479da49c3a4ce67dbadf, State: Running, Role: LEADER
I20260812 16:46:01.891193 23650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 16:46:01 dist-test-slave-45dx krb5kdc[23502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:01.891214 23659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c13ac457c3479da49c3a4ce67dbadf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37063 } }
I20260812 16:46:01.891655 23659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77c13ac457c3479da49c3a4ce67dbadf. Latest consensus state: current_term: 1 leader_uuid: "77c13ac457c3479da49c3a4ce67dbadf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c13ac457c3479da49c3a4ce67dbadf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37063 } } }
I20260812 16:46:01.891945 23659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:01.891863 23661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77c13ac457c3479da49c3a4ce67dbadf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c13ac457c3479da49c3a4ce67dbadf" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37063 } } }
I20260812 16:46:01.892387 23661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:01.892565 23673 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:01.893373 23673 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:01.895182 23673 catalog_manager.cc:1347] Generated new cluster ID: c940c61085b6462bab41f07383754af5
I20260812 16:46:01.895249 23673 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:01.895979 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:01.884563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43060 (local address 127.21.114.126:37063)
0812 16:46:01.884755 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:01.884764 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:01.884799 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:46:01.885325 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:01.885334 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:01.885397 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:01.885556 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:01.886201 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:01.887537 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:01.888250 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:01.888947 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:01.889076 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:01.891811 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:01.891815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:01.891815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:01.891826 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:01.893968 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:01.894397 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:01.894399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:01.894400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:01.894510 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:01.894715 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:01.894716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:01.894717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:01.895020 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:01.895138 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:01.895614 (+ 476us) server_negotiation.cc:299] Negotiation successful
0812 16:46:01.895763 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260812 16:46:01.899957 23673 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:01.900509 23673 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:01.907997 23673 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf: Generated new TSK 0
I20260812 16:46:01.908176 23673 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:46:01.937633 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37063
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:02.022456 23703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:02.022662 23703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:02.022686 23703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:02.023775 23703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:02.023808 23703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:02.023833 23703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:46:02.025309 23703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:02.025516 23703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:02.025697 23703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:02.030699 23709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.030668 23711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:02.030733 23703 server_base.cc:1034] running on GCE node
W20260812 16:46:02.030699 23713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:02.031147 23703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:02.031366 23703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:02.032507 23703 hybrid_clock.cc:648] HybridClock initialized: now 1786553162032485 us; error 39 us; skew 500 ppm
Aug 12 16:46:02 dist-test-slave-45dx krb5kdc[23502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553162, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:02.035032 23703 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:46:02.035494 23703 webserver.cc:460] Webserver started at http://127.21.114.65:46123/ using document root <none> and password file <none>
I20260812 16:46:02.035737 23703 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:02.035784 23703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:02.035951 23703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:02.037168 23703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "760e1321e027443b9d4a5284a2d117ee"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "50e84b6ce1114a20b73a8ea26a7d5166"
server_key_iv: "195f7750dc5e8c9addd812754d1e5db0"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.037547 23703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "760e1321e027443b9d4a5284a2d117ee"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "50e84b6ce1114a20b73a8ea26a7d5166"
server_key_iv: "195f7750dc5e8c9addd812754d1e5db0"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.038952 23703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:46:02.039737 23723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.039963 23703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:02.040076 23703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "760e1321e027443b9d4a5284a2d117ee"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "50e84b6ce1114a20b73a8ea26a7d5166"
server_key_iv: "195f7750dc5e8c9addd812754d1e5db0"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.040151 23703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:02.060650 23703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:02.062636 23703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:02.062819 23703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:02.063072 23703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:02.063445 23703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:02.063503 23703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.063550 23703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:02.063582 23703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.069633 23703 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:40191
I20260812 16:46:02.069689 23952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:40191 every 8 connection(s)
I20260812 16:46:02.070015 23703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:46:02.073107 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23703
I20260812 16:46:02.073216 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:46:02.073428 21961 external_mini_cluster.cc:1428] Setting key 7ac26146cb3b600a9d10a48840577b4c
Aug 12 16:46:02 dist-test-slave-45dx krb5kdc[23502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553162, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:02.080585 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.070731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:39641 (local address 127.21.114.126:37063)
0812 16:46:02.070782 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.070784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.071015 (+ 231us) server_negotiation.cc:407] Connection header received
0812 16:46:02.071495 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.071495 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.071506 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.071570 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:02.072621 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.073316 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.074533 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.074862 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.074944 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.077514 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:02.077516 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:02.077516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:02.077524 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:02.078976 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.079502 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.079503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.079504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.079557 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.079847 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.079848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.079848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.079951 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:02.080002 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.080418 (+ 416us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.080507 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:02.080823 23956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.070696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37063 (local address 127.21.114.65:39641)
0812 16:46:02.070868 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.070921 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.071412 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.071643 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.071646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.072250 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:02.072538 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.072544 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.073429 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.073430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.074437 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.074440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.074957 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.074958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.075058 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.075606 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:02.075615 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:02.077403 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:02.079081 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:02.079089 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:02.079092 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:02.079424 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:02.079623 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:02.079624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:02.079624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:02.079779 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:02.080022 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:02.080029 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:02.080213 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.080354 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.080547 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260812 16:46:02.081460 23954 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37063
I20260812 16:46:02.081578 23954 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:02.081770 23954 heartbeater.cc:511] Master 127.21.114.126:37063 requested a full tablet report, sending...
I20260812 16:46:02.082304 23590 ts_manager.cc:194] Registered new tserver with Master: 760e1321e027443b9d4a5284a2d117ee (127.21.114.65:40191)
I20260812 16:46:02.082939 23590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:39641
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:46:02.102787 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37063
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:02.187354 23965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:02.187619 23965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:02.187662 23965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:02.188969 23965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:02.189049 23965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:02.189095 23965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:46:02.190591 23965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:02.190860 23965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:02.191108 23965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:02.196400 23973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.196409 23975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.196411 23972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:02.196797 23965 server_base.cc:1034] running on GCE node
I20260812 16:46:02.197024 23965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:02.197273 23965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:02.198426 23965 hybrid_clock.cc:648] HybridClock initialized: now 1786553162198414 us; error 33 us; skew 500 ppm
Aug 12 16:46:02 dist-test-slave-45dx krb5kdc[23502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553162, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:02.206161 23965 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:46:02.206715 23965 webserver.cc:460] Webserver started at http://127.21.114.66:40261/ using document root <none> and password file <none>
I20260812 16:46:02.206983 23965 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:02.207032 23965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:02.207212 23965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:02.208400 23965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "99ea3a89306447419e7e09bb3cd7b0e2"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "8dac45821fc55a4048679d6879ec6c56"
server_key_iv: "c5f3838a936cd5256effabfd2e703e2f"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.208811 23965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "99ea3a89306447419e7e09bb3cd7b0e2"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "8dac45821fc55a4048679d6879ec6c56"
server_key_iv: "c5f3838a936cd5256effabfd2e703e2f"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.210216 23965 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:46:02.211014 23990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.211328 23965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:46:02.211447 23965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "99ea3a89306447419e7e09bb3cd7b0e2"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "8dac45821fc55a4048679d6879ec6c56"
server_key_iv: "c5f3838a936cd5256effabfd2e703e2f"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.211526 23965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:02.243052 23965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:02.245621 23965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:02.245792 23965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:02.246069 23965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:02.246418 23965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:02.246476 23965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.246521 23965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:02.246577 23965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.252758 23965 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:37327
I20260812 16:46:02.252802 24222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:37327 every 8 connection(s)
I20260812 16:46:02.253176 23965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:46:02.258700 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 23965
I20260812 16:46:02.258827 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:46:02.259027 21961 external_mini_cluster.cc:1428] Setting key a7866fa835ef706a624db74253c6467c
Aug 12 16:46:02 dist-test-slave-45dx krb5kdc[23502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553162, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:02.263345 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.253924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:40319 (local address 127.21.114.126:37063)
0812 16:46:02.253991 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.253993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.254172 (+ 179us) server_negotiation.cc:407] Connection header received
0812 16:46:02.254720 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.254722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.254735 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.254783 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:02.255781 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.256346 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.257365 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.257579 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.257666 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.259949 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:02.259951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:02.259951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:02.259959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:02.261560 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.262132 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.262133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.262134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.262203 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.262526 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.262528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.262528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.262686 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:02.262733 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.263135 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.263234 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 16:46:02.263984 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.253884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37063 (local address 127.21.114.66:40319)
0812 16:46:02.254041 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.254088 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.254603 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.254885 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.254889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.255466 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:02.255664 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.255669 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.256435 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.256436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.257256 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.257258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.257678 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.257679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.257808 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.258276 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:02.258285 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:02.259857 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:02.261666 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:02.261674 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:02.261676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:02.262029 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:02.262283 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:02.262284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:02.262284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:02.262440 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:02.262783 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:02.262789 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:02.262968 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.263506 (+ 538us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.263718 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260812 16:46:02.264683 24223 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37063
I20260812 16:46:02.264817 24223 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:02.265038 24223 heartbeater.cc:511] Master 127.21.114.126:37063 requested a full tablet report, sending...
I20260812 16:46:02.265476 23590 ts_manager.cc:194] Registered new tserver with Master: 99ea3a89306447419e7e09bb3cd7b0e2 (127.21.114.66:37327)
I20260812 16:46:02.266024 23590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:40319
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:46:02.288540 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37063
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:37081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:02.372717 24238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:02.372924 24238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:02.372947 24238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:02.374150 24238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:02.374191 24238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:02.374217 24238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:46:02.375604 24238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:37081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:02.375797 24238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:02.375993 24238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:02.380949 24250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.380959 24247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.380991 24246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:02.381157 24238 server_base.cc:1034] running on GCE node
I20260812 16:46:02.381345 24238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:02.381588 24238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:02.382766 24238 hybrid_clock.cc:648] HybridClock initialized: now 1786553162382740 us; error 42 us; skew 500 ppm
Aug 12 16:46:02 dist-test-slave-45dx krb5kdc[23502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553162, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:02.385281 24238 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:46:02.385735 24238 webserver.cc:460] Webserver started at http://127.21.114.67:36263/ using document root <none> and password file <none>
I20260812 16:46:02.385937 24238 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:02.385978 24238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:02.386065 24238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:02.387017 24238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "e6989c67f47a464d80bb084c15f1f7ec"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "21a86359498cd5cf97b277a3f9052704"
server_key_iv: "b5fac04c0028046838e242760c34f428"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.387315 24238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "e6989c67f47a464d80bb084c15f1f7ec"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "21a86359498cd5cf97b277a3f9052704"
server_key_iv: "b5fac04c0028046838e242760c34f428"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.388616 24238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:02.389323 24261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.389505 24238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:02.389598 24238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "e6989c67f47a464d80bb084c15f1f7ec"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "21a86359498cd5cf97b277a3f9052704"
server_key_iv: "b5fac04c0028046838e242760c34f428"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.389672 24238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:02.399871 24238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:02.401831 24238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:02.401990 24238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:02.402210 24238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:02.402513 24238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:02.402547 24238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.402568 24238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:02.402613 24238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.408763 24238 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:38271
I20260812 16:46:02.408825 24493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:38271 every 8 connection(s)
I20260812 16:46:02.409122 24238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:46:02.413970 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24238
I20260812 16:46:02.414076 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:46:02.414225 21961 external_mini_cluster.cc:1428] Setting key 0b82497363a6ffe5bd985d89d32f0d2e
Aug 12 16:46:02 dist-test-slave-45dx krb5kdc[23502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553162, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:02.418090 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.409828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:56801 (local address 127.21.114.126:37063)
0812 16:46:02.409890 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.409892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.410079 (+ 187us) server_negotiation.cc:407] Connection header received
0812 16:46:02.410533 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.410535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.410544 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.410601 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:02.411477 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.411965 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.412967 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.413151 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.413205 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.415665 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:02.415666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:02.415666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:02.415672 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:02.416952 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.417309 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.417310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.417310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.417361 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.417573 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.417574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.417574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.417674 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:02.417723 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.417966 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.418028 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:46:02.418246 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.409793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37063 (local address 127.21.114.67:56801)
0812 16:46:02.409952 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.409992 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.410453 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.410650 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.410654 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.411216 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:02.411403 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.411408 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.412044 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.412045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.412895 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.412897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.413226 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.413227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.413323 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.413871 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:02.413880 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:02.415600 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:02.417025 (+ 1425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:02.417030 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:02.417032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:02.417241 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:02.417420 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:02.417421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:02.417421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:02.417519 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:02.417729 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:02.417733 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:02.417839 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.417936 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.418052 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260812 16:46:02.418689 24494 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37063
I20260812 16:46:02.418797 24494 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:02.418975 24494 heartbeater.cc:511] Master 127.21.114.126:37063 requested a full tablet report, sending...
I20260812 16:46:02.419340 23590 ts_manager.cc:194] Registered new tserver with Master: e6989c67f47a464d80bb084c15f1f7ec (127.21.114.67:38271)
I20260812 16:46:02.419698 23590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:56801
I20260812 16:46:02.425839 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:46:02.432801 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.427101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48386 (local address 127.21.114.126:37063)
0812 16:46:02.427170 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.427172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.427259 (+ 87us) server_negotiation.cc:407] Connection header received
0812 16:46:02.427300 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.427301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.427312 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.427358 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:02.427852 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.428355 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.429014 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.429185 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.429232 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.430398 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:02.430399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:02.430399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:02.430405 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:02.431744 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.432082 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.432082 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.432083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.432136 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:02.432374 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:02.432375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:02.432375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:02.432497 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:02.432584 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.432694 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.432741 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:46:02.434332 23590 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48386:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:46:02.435989 23590 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:46:02.442881 24519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.438583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38271 (local address 127.0.0.1:37218)
0812 16:46:02.438923 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.438933 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.438972 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.439329 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.439332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.439335 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:02.439421 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.439423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.440412 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.440413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.441569 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.441572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.442551 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.442552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.442635 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.442651 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.442733 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.442798 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":103,"threads_started":1}
I20260812 16:46:02.443094 24513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.438556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:40191 (local address 127.0.0.1:42270)
0812 16:46:02.438745 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.438788 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.438860 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.439369 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.439369 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.439372 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:02.439425 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.439427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.440873 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.440874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.441936 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.441939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.442845 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.442846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.442904 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.442908 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.442939 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.442977 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":29,"thread_start_us":62,"threads_started":1}
I20260812 16:46:02.442898 24520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.438912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.21.114.67:38271)
0812 16:46:02.439120 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.439125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.439136 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:02.439179 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.439181 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.439201 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.439500 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:02.439572 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.440270 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.441662 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.442465 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.442540 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.442596 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.442762 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.442806 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":101,"threads_started":1}
I20260812 16:46:02.443279 24512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.438798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:37327 (local address 127.0.0.1:59382)
0812 16:46:02.439054 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.439064 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.439100 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.439501 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.439501 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.439503 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:02.439539 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.439540 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.440888 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.440889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.442034 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.442037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.443032 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.443033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.443091 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.443096 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.443151 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.443195 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":32,"thread_start_us":76,"threads_started":1}
I20260812 16:46:02.443506 24522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.438970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59382 (local address 127.21.114.66:37327)
0812 16:46:02.439263 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.439268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.439278 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:46:02.439316 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.439318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.439333 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.439406 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:02.439625 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.440757 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.442133 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.442858 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.442930 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.442989 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.443383 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.443425 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":75,"threads_started":1}
I20260812 16:46:02.443518 24515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.438691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42270 (local address 127.21.114.65:40191)
0812 16:46:02.439160 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.439165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.439177 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:46:02.439221 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.439223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.439240 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.439507 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:02.439603 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.440750 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.442029 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.442753 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.443273 (+ 520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.443348 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.443378 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.443429 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":92,"threads_started":1}
I20260812 16:46:02.443889 24353 tablet_service.cc:1467] Processing CreateTablet for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 (DEFAULT_TABLE table=test-table [id=591d339559af47c78cdfef19198c7c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:02.444166 23819 tablet_service.cc:1467] Processing CreateTablet for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 (DEFAULT_TABLE table=test-table [id=591d339559af47c78cdfef19198c7c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:02.444164 24083 tablet_service.cc:1467] Processing CreateTablet for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 (DEFAULT_TABLE table=test-table [id=591d339559af47c78cdfef19198c7c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:02.444335 24353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:02.444505 23819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:02.444545 24083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:02.447736 24523 tablet_bootstrap.cc:492] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Bootstrap starting.
I20260812 16:46:02.447952 24525 tablet_bootstrap.cc:492] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Bootstrap starting.
I20260812 16:46:02.448459 24524 tablet_bootstrap.cc:492] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: Bootstrap starting.
I20260812 16:46:02.448642 24525 tablet_bootstrap.cc:654] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:02.448702 24523 tablet_bootstrap.cc:654] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:02.449153 24524 tablet_bootstrap.cc:654] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:02.449277 24525 log.cc:824] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:02.449626 24523 log.cc:824] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:02.449774 24524 log.cc:824] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:02.450091 24525 tablet_bootstrap.cc:492] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: No bootstrap required, opened a new log
I20260812 16:46:02.450161 24525 ts_tablet_manager.cc:1397] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:02.450624 24524 tablet_bootstrap.cc:492] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: No bootstrap required, opened a new log
I20260812 16:46:02.450713 24524 ts_tablet_manager.cc:1397] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:02.452438 24525 raft_consensus.cc:348] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.452663 24525 raft_consensus.cc:374] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:02.452711 24525 raft_consensus.cc:729] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6989c67f47a464d80bb084c15f1f7ec, State: Initialized, Role: FOLLOWER
I20260812 16:46:02.452836 24525 consensus_queue.cc:260] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.453138 24525 ts_tablet_manager.cc:1428] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:46:02.453248 24523 tablet_bootstrap.cc:492] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: No bootstrap required, opened a new log
I20260812 16:46:02.453254 24494 heartbeater.cc:503] Master 127.21.114.126:37063 was elected leader, sending a full tablet report...
I20260812 16:46:02.453142 24524 raft_consensus.cc:348] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.453341 24523 ts_tablet_manager.cc:1397] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260812 16:46:02.453356 24524 raft_consensus.cc:374] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:02.453398 24524 raft_consensus.cc:729] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 760e1321e027443b9d4a5284a2d117ee, State: Initialized, Role: FOLLOWER
I20260812 16:46:02.453557 24524 consensus_queue.cc:260] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.453837 24524 ts_tablet_manager.cc:1428] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:46:02.453948 23954 heartbeater.cc:503] Master 127.21.114.126:37063 was elected leader, sending a full tablet report...
I20260812 16:46:02.455509 24523 raft_consensus.cc:348] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.455631 24523 raft_consensus.cc:374] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:02.455652 24523 raft_consensus.cc:729] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ea3a89306447419e7e09bb3cd7b0e2, State: Initialized, Role: FOLLOWER
I20260812 16:46:02.455762 24523 consensus_queue.cc:260] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.456055 24523 ts_tablet_manager.cc:1428] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 16:46:02.456103 24223 heartbeater.cc:503] Master 127.21.114.126:37063 was elected leader, sending a full tablet report...
W20260812 16:46:02.503769 24231 tablet.cc:2369] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:02.552318 24541 raft_consensus.cc:482] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:46:02.552475 24541 raft_consensus.cc:504] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.552865 24541 leader_election.cc:288] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 760e1321e027443b9d4a5284a2d117ee (127.21.114.65:40191), e6989c67f47a464d80bb084c15f1f7ec (127.21.114.67:38271)
I20260812 16:46:02.556809 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.553056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:38271 (local address 127.21.114.66:36533)
0812 16:46:02.553125 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.553138 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.553197 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.553387 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.553388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.553390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:02.553477 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.553479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.554411 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.554412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.555763 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.555767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.556531 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.556533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.556629 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.556633 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.556678 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.556712 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":94}
I20260812 16:46:02.556820 24520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.553140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:36533 (local address 127.21.114.67:38271)
0812 16:46:02.553189 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.553192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.553203 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:02.553270 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.553271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.553280 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.553369 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:02.553572 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.554321 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.555856 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.556462 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.556536 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.556542 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.556707 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.556757 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:46:02.556885 24515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.553145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:52535 (local address 127.21.114.65:40191)
0812 16:46:02.553189 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.553192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.553323 (+ 131us) server_negotiation.cc:407] Connection header received
0812 16:46:02.553356 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.553357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.553366 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.553423 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:02.553572 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.554325 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.555859 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.556462 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.556533 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.556542 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.556772 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.556810 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:46:02.556938 24542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.553056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:40191 (local address 127.21.114.66:52535)
0812 16:46:02.553251 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.553260 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.553315 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.553423 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.553424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.553425 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:02.553499 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.553500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.554411 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.554412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.555763 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.555767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.556594 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.556595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.556685 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.556689 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.556749 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.556789 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":115,"thread_start_us":111,"threads_started":1}
I20260812 16:46:02.557171 24398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49cfb60c7f4f5996feca1c7b0f67e2" candidate_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6989c67f47a464d80bb084c15f1f7ec" is_pre_election: true
I20260812 16:46:02.557224 23850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49cfb60c7f4f5996feca1c7b0f67e2" candidate_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "760e1321e027443b9d4a5284a2d117ee" is_pre_election: true
I20260812 16:46:02.557343 24398 raft_consensus.cc:2454] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ea3a89306447419e7e09bb3cd7b0e2 in term 0.
I20260812 16:46:02.557343 23850 raft_consensus.cc:2454] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ea3a89306447419e7e09bb3cd7b0e2 in term 0.
I20260812 16:46:02.557581 24000 leader_election.cc:302] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 760e1321e027443b9d4a5284a2d117ee, 99ea3a89306447419e7e09bb3cd7b0e2; no voters:
I20260812 16:46:02.557782 24541 raft_consensus.cc:2781] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:46:02.557860 24541 raft_consensus.cc:482] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:46:02.557898 24541 raft_consensus.cc:3037] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:02.558826 24541 raft_consensus.cc:504] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.558998 24541 leader_election.cc:288] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [CANDIDATE]: Term 1 election: Requested vote from peers 760e1321e027443b9d4a5284a2d117ee (127.21.114.65:40191), e6989c67f47a464d80bb084c15f1f7ec (127.21.114.67:38271)
I20260812 16:46:02.559140 23850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49cfb60c7f4f5996feca1c7b0f67e2" candidate_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "760e1321e027443b9d4a5284a2d117ee"
I20260812 16:46:02.559167 24398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d49cfb60c7f4f5996feca1c7b0f67e2" candidate_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6989c67f47a464d80bb084c15f1f7ec"
I20260812 16:46:02.559247 23850 raft_consensus.cc:3037] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:02.559242 24398 raft_consensus.cc:3037] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:02.559937 24398 raft_consensus.cc:2454] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ea3a89306447419e7e09bb3cd7b0e2 in term 1.
I20260812 16:46:02.560016 23850 raft_consensus.cc:2454] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ea3a89306447419e7e09bb3cd7b0e2 in term 1.
I20260812 16:46:02.560148 23997 leader_election.cc:302] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ea3a89306447419e7e09bb3cd7b0e2, e6989c67f47a464d80bb084c15f1f7ec; no voters:
I20260812 16:46:02.560268 24541 raft_consensus.cc:2781] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:02.560474 24541 raft_consensus.cc:686] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 1 LEADER]: Becoming Leader. State: Replica: 99ea3a89306447419e7e09bb3cd7b0e2, State: Running, Role: LEADER
I20260812 16:46:02.560581 24541 consensus_queue.cc:237] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } }
I20260812 16:46:02.561404 23590 catalog_manager.cc:5495] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ea3a89306447419e7e09bb3cd7b0e2 (127.21.114.66). New cstate: current_term: 1 leader_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ea3a89306447419e7e09bb3cd7b0e2" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 37327 } health_report { overall_health: HEALTHY } } }
W20260812 16:46:02.570676 23955 tablet.cc:2369] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:02.592075 24522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.589808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59396 (local address 127.21.114.66:37327)
0812 16:46:02.589870 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.589873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.589882 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:02.589925 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.589925 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.589942 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.590003 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:02.590130 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.590590 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.591285 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.591555 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.591607 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.591786 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:02.591873 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:02.591957 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.592009 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.592018 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 16:46:02.594044 23850 raft_consensus.cc:1261] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 760e1321e027443b9d4a5284a2d117ee [term 1 FOLLOWER]: Refusing update from remote peer 99ea3a89306447419e7e09bb3cd7b0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:02.594098 24398 raft_consensus.cc:1261] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 1 FOLLOWER]: Refusing update from remote peer 99ea3a89306447419e7e09bb3cd7b0e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:02.594471 24543 consensus_queue.cc:1035] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6989c67f47a464d80bb084c15f1f7ec" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:02.594595 24541 consensus_queue.cc:1035] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "760e1321e027443b9d4a5284a2d117ee" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:02.597479 24549 mvcc.cc:205] Tried to move back new op lower bound from 7317721753982308352 to 7317721753848643584. Current Snapshot: MvccSnapshot[applied={T|T < 7317721753982308352}]
I20260812 16:46:02.598045 24548 mvcc.cc:205] Tried to move back new op lower bound from 7317721753982308352 to 7317721753848643584. Current Snapshot: MvccSnapshot[applied={T|T < 7317721753982308352 or (T in {7317721753982308352})}]
I20260812 16:46:02.599367 23590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:02.599462 23590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:02.600204 23590 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77c13ac457c3479da49c3a4ce67dbadf: Sending DeleteTablet for 3 replicas of tablet 6d49cfb60c7f4f5996feca1c7b0f67e2
I20260812 16:46:02.600580 23819 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:02 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:42270
I20260812 16:46:02.600594 24353 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:02 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:37218
I20260812 16:46:02.600817 24568 tablet_replica.cc:330] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: stopping tablet replica
I20260812 16:46:02.600817 24083 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:02 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:59382
I20260812 16:46:02.600919 24568 raft_consensus.cc:2229] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:02.601035 24568 raft_consensus.cc:2258] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:02.601055 24570 tablet_replica.cc:330] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: stopping tablet replica
I20260812 16:46:02.601239 24570 raft_consensus.cc:2229] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:46:02.601310 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23703
I20260812 16:46:02.601496 24568 ts_tablet_manager.cc:1905] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:02.601639 24570 raft_consensus.cc:2258] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:02.602433 24570 ts_tablet_manager.cc:1905] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:02.603838 24568 ts_tablet_manager.cc:1918] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:02.603922 24568 log.cc:1196] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/6d49cfb60c7f4f5996feca1c7b0f67e2
I20260812 16:46:02.604250 24568 ts_tablet_manager.cc:1939] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P e6989c67f47a464d80bb084c15f1f7ec: Deleting consensus metadata
I20260812 16:46:02.604699 23558 catalog_manager.cc:4841] TS e6989c67f47a464d80bb084c15f1f7ec (127.21.114.67:38271): tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 (table test-table [id=591d339559af47c78cdfef19198c7c00]) successfully deleted
I20260812 16:46:02.605010 24570 ts_tablet_manager.cc:1918] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:02.605108 24570 log.cc:1196] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/6d49cfb60c7f4f5996feca1c7b0f67e2
I20260812 16:46:02.605446 24570 ts_tablet_manager.cc:1939] T 6d49cfb60c7f4f5996feca1c7b0f67e2 P 99ea3a89306447419e7e09bb3cd7b0e2: Deleting consensus metadata
I20260812 16:46:02.605906 23558 catalog_manager.cc:4841] TS 99ea3a89306447419e7e09bb3cd7b0e2 (127.21.114.66:37327): tablet 6d49cfb60c7f4f5996feca1c7b0f67e2 (table test-table [id=591d339559af47c78cdfef19198c7c00]) successfully deleted
W20260812 16:46:02.619876 23561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:40191 (error 108)
I20260812 16:46:02.620095 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23965
I20260812 16:46:02.622498 24512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.622330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:40191 (local address 127.0.0.1:42282)
0812 16:46:02.622392 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.622447 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:40191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 16:46:02.622663 23561 catalog_manager.cc:4584] TS 760e1321e027443b9d4a5284a2d117ee (127.21.114.65:40191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d49cfb60c7f4f5996feca1c7b0f67e2: Network error: Client connection negotiation failed: client connection to 127.21.114.65:40191: connect: Connection refused (error 111)
I20260812 16:46:02.633455 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24238
I20260812 16:46:02.647425 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 23526
2026-08-12T16:46:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2330 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T16:46:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:02Z Disabled control of system clock
I20260812 16:46:02.681924 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42687
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:46:02.763674 24578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:02.763893 24578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:02.763922 24578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:02.765111 24578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:02.765153 24578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:02.765166 24578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:02.765178 24578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:02.765190 24578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:02.766557 24578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42687
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:02.766812 24578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:02.767129 24578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:02.771970 24595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.771940 24589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.771962 24587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:02.772202 24578 server_base.cc:1034] running on GCE node
I20260812 16:46:02.772486 24578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:02.772737 24578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:02.773881 24578 hybrid_clock.cc:648] HybridClock initialized: now 1786553162773860 us; error 44 us; skew 500 ppm
I20260812 16:46:02.775205 24578 webserver.cc:460] Webserver started at http://127.21.114.126:42225/ using document root <none> and password file <none>
I20260812 16:46:02.775462 24578 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:02.775538 24578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:02.775708 24578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:02.776861 24578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "b88ebbf2911e438280d637cf7836647e"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "09989e49cace1a8d604a29cd4c59835f"
server_key_iv: "204213383f3b9a847ff3b1028ae7ca3c"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.777243 24578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "b88ebbf2911e438280d637cf7836647e"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "09989e49cace1a8d604a29cd4c59835f"
server_key_iv: "204213383f3b9a847ff3b1028ae7ca3c"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.778568 24578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:46:02.779320 24603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.779521 24578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:46:02.779631 24578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b88ebbf2911e438280d637cf7836647e"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "09989e49cace1a8d604a29cd4c59835f"
server_key_iv: "204213383f3b9a847ff3b1028ae7ca3c"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.779709 24578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:02.786193 24578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:02.786494 24578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:02.786645 24578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:02.790668 24578 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:42687
I20260812 16:46:02.790699 24703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:42687 every 8 connection(s)
I20260812 16:46:02.791031 24578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:02.791978 24705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:02.794281 24705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e: Bootstrap starting.
I20260812 16:46:02.794817 24705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:02.795073 24705 log.cc:824] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:02.795712 24705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e: No bootstrap required, opened a new log
I20260812 16:46:02.796270 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24578
I20260812 16:46:02.796402 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:02.796610 21961 external_mini_cluster.cc:1428] Setting key 23b2b463e0e430a74a6003e76673a975
I20260812 16:46:02.797940 24705 raft_consensus.cc:348] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b88ebbf2911e438280d637cf7836647e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42687 } }
I20260812 16:46:02.798115 24705 raft_consensus.cc:374] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:02.798152 24705 raft_consensus.cc:729] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88ebbf2911e438280d637cf7836647e, State: Initialized, Role: FOLLOWER
I20260812 16:46:02.798300 24705 consensus_queue.cc:260] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b88ebbf2911e438280d637cf7836647e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42687 } }
I20260812 16:46:02.798424 24705 raft_consensus.cc:388] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:02.798460 24705 raft_consensus.cc:482] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:02.798506 24705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:02.799257 24705 raft_consensus.cc:504] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b88ebbf2911e438280d637cf7836647e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42687 } }
I20260812 16:46:02.799369 24705 leader_election.cc:302] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b88ebbf2911e438280d637cf7836647e; no voters:
I20260812 16:46:02.799540 24705 leader_election.cc:288] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:02.799621 24714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:02.799791 24705 sys_catalog.cc:564] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:02.799810 24714 raft_consensus.cc:686] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [term 1 LEADER]: Becoming Leader. State: Replica: b88ebbf2911e438280d637cf7836647e, State: Running, Role: LEADER
I20260812 16:46:02.799899 24714 consensus_queue.cc:237] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b88ebbf2911e438280d637cf7836647e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42687 } }
I20260812 16:46:02.800225 24714 sys_catalog.cc:455] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b88ebbf2911e438280d637cf7836647e. Latest consensus state: current_term: 1 leader_uuid: "b88ebbf2911e438280d637cf7836647e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b88ebbf2911e438280d637cf7836647e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42687 } } }
I20260812 16:46:02.800236 24715 sys_catalog.cc:455] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b88ebbf2911e438280d637cf7836647e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b88ebbf2911e438280d637cf7836647e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42687 } } }
I20260812 16:46:02.800971 24715 sys_catalog.cc:458] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:02.800365 24714 sys_catalog.cc:458] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:02.801338 24737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:02.801980 24737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:02.803524 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.797181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39722 (local address 127.21.114.126:42687)
0812 16:46:02.797424 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.797433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.797475 (+ 42us) server_negotiation.cc:407] Connection header received
0812 16:46:02.797898 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.797907 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.797989 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.798142 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:02.798396 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.800222 (+ 1826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.801339 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.801903 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.802030 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.802781 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:02.802785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:02.802785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:02.802990 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:02.803037 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:02.803052 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:02.803127 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.803217 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.803298 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":81,"threads_started":1}
I20260812 16:46:02.804226 24737 catalog_manager.cc:1347] Generated new cluster ID: ee49987558004c99aa8f17e32857573c
I20260812 16:46:02.804282 24737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:02.817395 24737 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:02.818125 24737 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:02.826265 24737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e: Generated new TSK 0
I20260812 16:46:02.826498 24737 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:02.831151 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42687
--builtin_ntp_servers=127.21.114.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:46:02.915030 24745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:02.915257 24745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:02.915279 24745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:02.916503 24745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:02.916575 24745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:02.916615 24745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:46:02.918006 24745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:02.918284 24745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:02.918598 24745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:02.924717 24760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.924712 24753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:02.924736 24751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:02.925182 24745 server_base.cc:1034] running on GCE node
I20260812 16:46:02.925469 24745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:02.925817 24745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:02.926987 24745 hybrid_clock.cc:648] HybridClock initialized: now 1786553162926960 us; error 40 us; skew 500 ppm
I20260812 16:46:02.928473 24745 webserver.cc:460] Webserver started at http://127.21.114.65:34953/ using document root <none> and password file <none>
I20260812 16:46:02.928730 24745 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:02.928790 24745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:02.928918 24745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:02.930337 24745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "bed89b6371ca48edb09c9d8d24021291"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "2e654087421a0bf13808c6a58998cc22"
server_key_iv: "a46520945525ff87484d89cc7302c1b1"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.930761 24745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "bed89b6371ca48edb09c9d8d24021291"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "2e654087421a0bf13808c6a58998cc22"
server_key_iv: "a46520945525ff87484d89cc7302c1b1"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.932431 24745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260812 16:46:02.933416 24773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.933609 24745 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:02.933709 24745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "bed89b6371ca48edb09c9d8d24021291"
format_stamp: "Formatted at 2026-08-12 16:46:02 on dist-test-slave-45dx"
server_key: "2e654087421a0bf13808c6a58998cc22"
server_key_iv: "a46520945525ff87484d89cc7302c1b1"
server_key_version: "encryptionkey@0"
I20260812 16:46:02.933784 24745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:02.945614 24745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:02.945905 24745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:02.946017 24745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:02.946208 24745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:02.946509 24745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:02.946542 24745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.946565 24745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:02.946578 24745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:02.952723 24745 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:37101
I20260812 16:46:02.952782 24991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:37101 every 8 connection(s)
I20260812 16:46:02.953126 24745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:46:02.957201 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 24745
I20260812 16:46:02.957329 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:46:02.957547 21961 external_mini_cluster.cc:1428] Setting key 044f6aad683021db1222ec8fa3b2e608
I20260812 16:46:02.958630 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42687
--builtin_ntp_servers=127.21.114.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 16:46:02.958915 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.953940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:40527 (local address 127.21.114.126:42687)
0812 16:46:02.954007 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:02.954009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:02.954263 (+ 254us) server_negotiation.cc:407] Connection header received
0812 16:46:02.954800 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:02.954801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:02.954817 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:02.954881 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:02.955576 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.956092 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.957183 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.957463 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.957553 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.958606 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:02.958608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:02.958608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:02.958613 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:02.958629 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:02.958633 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:02.958683 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:02.958791 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 16:46:02.958819 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:46:02.959307 24999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:02.953940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42687 (local address 127.21.114.65:40527)
0812 16:46:02.954141 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:02.954176 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:02.954692 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:02.954966 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:02.954969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:02.954978 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:02.955477 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.955482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.956192 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.956192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.957086 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:02.957089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:02.957563 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:02.957564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:02.957750 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:02.958458 (+ 708us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:46:02.958458 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:02.958486 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:46:02.958508 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:02.958690 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:02.958695 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:02.958698 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:02.959041 (+ 343us) client_negotiation.cc:240] Negotiation successful
0812 16:46:02.959149 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260812 16:46:02.959745 24997 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42687
I20260812 16:46:02.959856 24997 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:02.960053 24997 heartbeater.cc:511] Master 127.21.114.126:42687 requested a full tablet report, sending...
I20260812 16:46:02.960584 24639 ts_manager.cc:194] Registered new tserver with Master: bed89b6371ca48edb09c9d8d24021291 (127.21.114.65:37101)
I20260812 16:46:02.961198 24639 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.65:40527
W20260812 16:46:03.043206 25000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:03.043430 25000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:03.043454 25000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:03.044705 25000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:03.044750 25000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:03.044777 25000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:46:03.046120 25000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:03.046353 25000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:03.046689 25000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:03.051791 25007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:03.051805 25009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:03.051810 25012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:03.052124 25000 server_base.cc:1034] running on GCE node
I20260812 16:46:03.052440 25000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:03.052696 25000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:03.053838 25000 hybrid_clock.cc:648] HybridClock initialized: now 1786553163053818 us; error 41 us; skew 500 ppm
I20260812 16:46:03.055197 25000 webserver.cc:460] Webserver started at http://127.21.114.66:41557/ using document root <none> and password file <none>
I20260812 16:46:03.055459 25000 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:03.055510 25000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:03.055692 25000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:03.056865 25000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "14c7f34dec9e45b3bc326c9f14fc521d"
format_stamp: "Formatted at 2026-08-12 16:46:03 on dist-test-slave-45dx"
server_key: "f8cd227a87fe2c7c87f8addd85fb340b"
server_key_iv: "63bfc308d853b4847412241c0c7a64c9"
server_key_version: "encryptionkey@0"
I20260812 16:46:03.057235 25000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "14c7f34dec9e45b3bc326c9f14fc521d"
format_stamp: "Formatted at 2026-08-12 16:46:03 on dist-test-slave-45dx"
server_key: "f8cd227a87fe2c7c87f8addd85fb340b"
server_key_iv: "63bfc308d853b4847412241c0c7a64c9"
server_key_version: "encryptionkey@0"
I20260812 16:46:03.058523 25000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:03.059237 25028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:03.059445 25000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:03.059540 25000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "14c7f34dec9e45b3bc326c9f14fc521d"
format_stamp: "Formatted at 2026-08-12 16:46:03 on dist-test-slave-45dx"
server_key: "f8cd227a87fe2c7c87f8addd85fb340b"
server_key_iv: "63bfc308d853b4847412241c0c7a64c9"
server_key_version: "encryptionkey@0"
I20260812 16:46:03.059613 25000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:03.071835 25000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:03.072149 25000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:03.072399 25000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:03.072654 25000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:03.073004 25000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:03.073038 25000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:03.073062 25000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:03.073112 25000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:03.078931 25000 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:38269
I20260812 16:46:03.079001 25259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:38269 every 8 connection(s)
I20260812 16:46:03.079344 25000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:46:03.084987 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25000
I20260812 16:46:03.085023 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.080127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:43075 (local address 127.21.114.126:42687)
0812 16:46:03.080177 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.080179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.080424 (+ 245us) server_negotiation.cc:407] Connection header received
0812 16:46:03.080966 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.080968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.080981 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.081040 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:03.081750 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.082347 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.083498 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.083720 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.083799 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.084695 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:03.084697 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:03.084697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:03.084701 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:03.084716 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:03.084720 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:03.084804 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.084891 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.084926 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:46:03.085098 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:46:03.085175 25266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.080083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42687 (local address 127.21.114.66:43075)
0812 16:46:03.080263 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.080312 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.080852 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.081108 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.081112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.081122 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:03.081641 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.081646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.082445 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.082446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.083405 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.083408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.083808 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.083809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.083952 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.084561 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:46:03.084561 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:03.084590 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:46:03.084611 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:03.084810 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:03.084814 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:03.084817 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.084868 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.084958 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260812 16:46:03.085371 21961 external_mini_cluster.cc:1428] Setting key d2e70850add40656add287f7afd11e21
I20260812 16:46:03.085793 25260 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42687
I20260812 16:46:03.085901 25260 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:03.086090 25260 heartbeater.cc:511] Master 127.21.114.126:42687 requested a full tablet report, sending...
I20260812 16:46:03.086438 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42687
--builtin_ntp_servers=127.21.114.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 16:46:03.086504 24639 ts_manager.cc:194] Registered new tserver with Master: 14c7f34dec9e45b3bc326c9f14fc521d (127.21.114.66:38269)
I20260812 16:46:03.086908 24639 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.66:43075
W20260812 16:46:03.172125 25267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:03.172389 25267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:03.172416 25267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:03.173513 25267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:03.173547 25267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:03.173571 25267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:46:03.174834 25267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:42687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:03.175014 25267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:03.175262 25267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:03.180560 25278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:03.180573 25267 server_base.cc:1034] running on GCE node
W20260812 16:46:03.180542 25282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:03.180542 25280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:03.181010 25267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:03.181305 25267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:03.182451 25267 hybrid_clock.cc:648] HybridClock initialized: now 1786553163182439 us; error 29 us; skew 500 ppm
I20260812 16:46:03.183856 25267 webserver.cc:460] Webserver started at http://127.21.114.67:33273/ using document root <none> and password file <none>
I20260812 16:46:03.184126 25267 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:03.184172 25267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:03.184369 25267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:03.185465 25267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "c744db81895b44f2905d6377354389dd"
format_stamp: "Formatted at 2026-08-12 16:46:03 on dist-test-slave-45dx"
server_key: "0b3695ff4fab8203dd200a1695c2a33f"
server_key_iv: "68dd4c29f9d44716b03e14c5012668b0"
server_key_version: "encryptionkey@0"
I20260812 16:46:03.185853 25267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "c744db81895b44f2905d6377354389dd"
format_stamp: "Formatted at 2026-08-12 16:46:03 on dist-test-slave-45dx"
server_key: "0b3695ff4fab8203dd200a1695c2a33f"
server_key_iv: "68dd4c29f9d44716b03e14c5012668b0"
server_key_version: "encryptionkey@0"
I20260812 16:46:03.187150 25267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:03.187865 25289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:03.188057 25267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:03.188151 25267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "c744db81895b44f2905d6377354389dd"
format_stamp: "Formatted at 2026-08-12 16:46:03 on dist-test-slave-45dx"
server_key: "0b3695ff4fab8203dd200a1695c2a33f"
server_key_iv: "68dd4c29f9d44716b03e14c5012668b0"
server_key_version: "encryptionkey@0"
I20260812 16:46:03.188232 25267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:03.199535 25267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:03.199842 25267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:03.199992 25267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:03.200248 25267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:03.200642 25267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:03.200713 25267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:03.200758 25267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:03.200784 25267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:03.207044 25267 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:45555
I20260812 16:46:03.207082 25503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:45555 every 8 connection(s)
I20260812 16:46:03.207453 25267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:46:03.212447 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25267
I20260812 16:46:03.212589 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:46:03.212821 21961 external_mini_cluster.cc:1428] Setting key 211cbfd56581a829f70a203cbfe88915
I20260812 16:46:03.212838 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.208233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:58333 (local address 127.21.114.126:42687)
0812 16:46:03.208349 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.208351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.208590 (+ 239us) server_negotiation.cc:407] Connection header received
0812 16:46:03.209070 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.209071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.209084 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.209135 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:03.209804 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.210307 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.211274 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.211465 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.211521 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.212461 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:03.212463 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:03.212463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:03.212468 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:03.212491 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:03.212495 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:03.212579 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.212725 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.212754 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 16:46:03.213073 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.208219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:42687 (local address 127.21.114.67:58333)
0812 16:46:03.208459 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.208495 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.208978 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.209198 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.209201 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.209210 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:03.209730 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.209735 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.210393 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.210394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.211182 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.211184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.211544 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.211545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.211658 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.212265 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:46:03.212266 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:03.212330 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:46:03.212362 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:03.212626 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:03.212633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:03.212636 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.212708 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.212827 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":145,"threads_started":1}
I20260812 16:46:03.213613 25504 heartbeater.cc:347] Connected to a master server at 127.21.114.126:42687
I20260812 16:46:03.213728 25504 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:03.213954 25504 heartbeater.cc:511] Master 127.21.114.126:42687 requested a full tablet report, sending...
I20260812 16:46:03.214370 24639 ts_manager.cc:194] Registered new tserver with Master: c744db81895b44f2905d6377354389dd (127.21.114.67:45555)
I20260812 16:46:03.214731 24639 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.67:58333
I20260812 16:46:03.224910 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:46:03.229094 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.226333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39728 (local address 127.21.114.126:42687)
0812 16:46:03.226402 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.226404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.226509 (+ 105us) server_negotiation.cc:407] Connection header received
0812 16:46:03.226551 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.226552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.226563 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.226611 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:03.226727 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.227199 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.227902 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.228081 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.228132 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.228829 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:03.228830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:03.228830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:03.228834 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:03.228865 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:03.228869 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:03.228964 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.229024 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.229035 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:46:03.230638 24639 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:46:03.232124 24639 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:46:03.238511 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.234272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:45555 (local address 127.0.0.1:56722)
0812 16:46:03.234546 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.234555 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.234595 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.234870 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.234873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.234875 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:03.234945 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.234946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.236177 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.236178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.237253 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.237257 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.238198 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.238199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.238282 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.238294 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.238379 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.238436 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":66,"thread_start_us":57,"threads_started":1}
I20260812 16:46:03.238525 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.234523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56722 (local address 127.21.114.67:45555)
0812 16:46:03.234681 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.234686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.234697 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:03.234741 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.234743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.234759 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.234851 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:03.235024 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.236108 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.237339 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.238096 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.238199 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.238296 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.238399 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.238436 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260812 16:46:03.238674 25520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.234270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:38269 (local address 127.0.0.1:41752)
0812 16:46:03.234459 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.234496 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.234566 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.235065 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.235066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.235068 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:03.235098 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.235099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.236103 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.236104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.237371 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.237373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.238394 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.238396 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.238464 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.238468 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.238500 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.238563 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":39,"thread_start_us":89,"threads_started":1}
I20260812 16:46:03.239084 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.234273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:37101 (local address 127.0.0.1:36304)
0812 16:46:03.234668 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.234675 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.234708 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.235352 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.235353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.235355 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:03.235402 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.235403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.236648 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.236649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.237744 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.237747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.238634 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.238635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.238696 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.238699 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.238731 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.238771 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260812 16:46:03.239245 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.234711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41752 (local address 127.21.114.66:38269)
0812 16:46:03.234916 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.234920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.234931 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:03.234969 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.234970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.234986 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.235068 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:03.235216 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.236014 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.237600 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.238281 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.238977 (+ 696us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.239071 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.239098 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.239142 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260812 16:46:03.239212 25380 tablet_service.cc:1467] Processing CreateTablet for tablet aa2c8873b9c6499ba72a16b0c74823a6 (DEFAULT_TABLE table=test-table [id=c06785d333454203acbaffb9ec1bc1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:03.239501 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.234353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36304 (local address 127.21.114.65:37101)
0812 16:46:03.234951 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.234955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.234967 (+ 12us) server_negotiation.cc:407] Connection header received
0812 16:46:03.235030 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.235032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.235186 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.235293 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:03.235481 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.236545 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.237834 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.238544 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.239267 (+ 723us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.239364 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.239389 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.239443 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":103,"threads_started":1}
I20260812 16:46:03.239650 25380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa2c8873b9c6499ba72a16b0c74823a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:03.239953 25133 tablet_service.cc:1467] Processing CreateTablet for tablet aa2c8873b9c6499ba72a16b0c74823a6 (DEFAULT_TABLE table=test-table [id=c06785d333454203acbaffb9ec1bc1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:03.240041 24868 tablet_service.cc:1467] Processing CreateTablet for tablet aa2c8873b9c6499ba72a16b0c74823a6 (DEFAULT_TABLE table=test-table [id=c06785d333454203acbaffb9ec1bc1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:03.240341 24868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa2c8873b9c6499ba72a16b0c74823a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:03.240334 25133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa2c8873b9c6499ba72a16b0c74823a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:03.242466 25528 tablet_bootstrap.cc:492] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Bootstrap starting.
I20260812 16:46:03.243235 25528 tablet_bootstrap.cc:654] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:03.243566 25528 log.cc:824] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:03.243831 25531 tablet_bootstrap.cc:492] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: Bootstrap starting.
I20260812 16:46:03.244469 25529 tablet_bootstrap.cc:492] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Bootstrap starting.
I20260812 16:46:03.244505 25528 tablet_bootstrap.cc:492] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: No bootstrap required, opened a new log
I20260812 16:46:03.244554 25531 tablet_bootstrap.cc:654] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:03.244581 25528 ts_tablet_manager.cc:1397] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:03.244864 25531 log.cc:824] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:03.245083 25529 tablet_bootstrap.cc:654] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:03.245409 25529 log.cc:824] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:03.245747 25531 tablet_bootstrap.cc:492] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: No bootstrap required, opened a new log
I20260812 16:46:03.245862 25531 ts_tablet_manager.cc:1397] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:03.246049 25529 tablet_bootstrap.cc:492] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: No bootstrap required, opened a new log
I20260812 16:46:03.246127 25529 ts_tablet_manager.cc:1397] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:46:03.247336 25528 raft_consensus.cc:348] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.247515 25528 raft_consensus.cc:374] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:03.247552 25528 raft_consensus.cc:729] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c744db81895b44f2905d6377354389dd, State: Initialized, Role: FOLLOWER
I20260812 16:46:03.247694 25528 consensus_queue.cc:260] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.247980 25528 ts_tablet_manager.cc:1428] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 16:46:03.248032 25504 heartbeater.cc:503] Master 127.21.114.126:42687 was elected leader, sending a full tablet report...
I20260812 16:46:03.248157 25529 raft_consensus.cc:348] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.248298 25529 raft_consensus.cc:374] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:03.248358 25529 raft_consensus.cc:729] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c7f34dec9e45b3bc326c9f14fc521d, State: Initialized, Role: FOLLOWER
I20260812 16:46:03.248492 25529 consensus_queue.cc:260] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.248533 25531 raft_consensus.cc:348] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.248682 25531 raft_consensus.cc:374] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:03.248728 25531 raft_consensus.cc:729] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed89b6371ca48edb09c9d8d24021291, State: Initialized, Role: FOLLOWER
I20260812 16:46:03.248770 25529 ts_tablet_manager.cc:1428] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 16:46:03.248863 25531 consensus_queue.cc:260] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.249092 25260 heartbeater.cc:503] Master 127.21.114.126:42687 was elected leader, sending a full tablet report...
I20260812 16:46:03.249161 25531 ts_tablet_manager.cc:1428] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:46:03.249270 24997 heartbeater.cc:503] Master 127.21.114.126:42687 was elected leader, sending a full tablet report...
W20260812 16:46:03.329946 25265 tablet.cc:2369] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:03.388460 25546 raft_consensus.cc:482] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:46:03.388592 25546 raft_consensus.cc:504] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.389055 25546 leader_election.cc:288] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14c7f34dec9e45b3bc326c9f14fc521d (127.21.114.66:38269), c744db81895b44f2905d6377354389dd (127.21.114.67:45555)
I20260812 16:46:03.392967 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.389331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:41349 (local address 127.21.114.67:45555)
0812 16:46:03.389382 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.389384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.389655 (+ 271us) server_negotiation.cc:407] Connection header received
0812 16:46:03.389707 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.389708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.389718 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.389777 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:03.389926 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.390591 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.391956 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.392563 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.392642 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.392651 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.392841 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.392882 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 16:46:03.392967 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.389308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:53959 (local address 127.21.114.66:38269)
0812 16:46:03.389356 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.389359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.389370 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:03.389438 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.389439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.389449 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.389516 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:03.389703 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.390502 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.391957 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.392564 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.392643 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.392651 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.392842 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.392894 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:46:03.392974 24999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.389229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:38269 (local address 127.21.114.65:53959)
0812 16:46:03.389299 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.389311 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.389371 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.389538 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.389539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.389541 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:03.389625 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.389627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.390582 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.390583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.391844 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.391847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.392652 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.392653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.392757 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.392761 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.392822 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.392878 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":7}
I20260812 16:46:03.392987 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.389230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:45555 (local address 127.21.114.65:41349)
0812 16:46:03.389572 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.389583 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:03.389647 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:03.389786 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:03.389787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:03.389788 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:03.389839 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.389840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.390669 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.390670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.391846 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:03.391878 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.392652 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.392653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:03.392757 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.392762 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:46:03.392822 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 16:46:03.392878 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":137,"thread_start_us":144,"threads_started":1}
I20260812 16:46:03.393394 25176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2c8873b9c6499ba72a16b0c74823a6" candidate_uuid: "bed89b6371ca48edb09c9d8d24021291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" is_pre_election: true
I20260812 16:46:03.393565 25176 raft_consensus.cc:2454] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed89b6371ca48edb09c9d8d24021291 in term 0.
I20260812 16:46:03.393658 25424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2c8873b9c6499ba72a16b0c74823a6" candidate_uuid: "bed89b6371ca48edb09c9d8d24021291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c744db81895b44f2905d6377354389dd" is_pre_election: true
I20260812 16:46:03.393808 25424 raft_consensus.cc:2454] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed89b6371ca48edb09c9d8d24021291 in term 0.
I20260812 16:46:03.393833 24783 leader_election.cc:302] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c7f34dec9e45b3bc326c9f14fc521d, bed89b6371ca48edb09c9d8d24021291; no voters:
I20260812 16:46:03.393999 25546 raft_consensus.cc:2781] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:46:03.394079 25546 raft_consensus.cc:482] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:46:03.394106 25546 raft_consensus.cc:3037] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:03.394840 25546 raft_consensus.cc:504] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.395220 25546 leader_election.cc:288] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [CANDIDATE]: Term 1 election: Requested vote from peers 14c7f34dec9e45b3bc326c9f14fc521d (127.21.114.66:38269), c744db81895b44f2905d6377354389dd (127.21.114.67:45555)
I20260812 16:46:03.395401 25424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2c8873b9c6499ba72a16b0c74823a6" candidate_uuid: "bed89b6371ca48edb09c9d8d24021291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c744db81895b44f2905d6377354389dd"
I20260812 16:46:03.395392 25176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2c8873b9c6499ba72a16b0c74823a6" candidate_uuid: "bed89b6371ca48edb09c9d8d24021291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c7f34dec9e45b3bc326c9f14fc521d"
I20260812 16:46:03.395481 25176 raft_consensus.cc:3037] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:03.395481 25424 raft_consensus.cc:3037] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:03.396468 25176 raft_consensus.cc:2454] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed89b6371ca48edb09c9d8d24021291 in term 1.
I20260812 16:46:03.396468 25424 raft_consensus.cc:2454] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed89b6371ca48edb09c9d8d24021291 in term 1.
I20260812 16:46:03.396656 24779 leader_election.cc:302] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bed89b6371ca48edb09c9d8d24021291, c744db81895b44f2905d6377354389dd; no voters:
I20260812 16:46:03.396757 25546 raft_consensus.cc:2781] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:03.396911 25546 raft_consensus.cc:686] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 1 LEADER]: Becoming Leader. State: Replica: bed89b6371ca48edb09c9d8d24021291, State: Running, Role: LEADER
I20260812 16:46:03.397012 25546 consensus_queue.cc:237] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } }
I20260812 16:46:03.397858 24637 catalog_manager.cc:5495] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed89b6371ca48edb09c9d8d24021291 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "bed89b6371ca48edb09c9d8d24021291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed89b6371ca48edb09c9d8d24021291" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 } health_report { overall_health: UNKNOWN } } }
I20260812 16:46:03.423295 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.420718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36308 (local address 127.21.114.65:37101)
0812 16:46:03.420788 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:03.420790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:03.420797 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:46:03.420845 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:03.420846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:03.420867 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:03.420959 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:03.421112 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.421607 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.422433 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:03.422645 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:03.422725 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:03.422877 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:03.422984 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:03.423095 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:03.423165 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 16:46:03.423176 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:46:03.425333 25424 raft_consensus.cc:1261] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 1 FOLLOWER]: Refusing update from remote peer bed89b6371ca48edb09c9d8d24021291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:03.425315 25176 raft_consensus.cc:1261] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 1 FOLLOWER]: Refusing update from remote peer bed89b6371ca48edb09c9d8d24021291: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:03.425777 25554 consensus_queue.cc:1035] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c7f34dec9e45b3bc326c9f14fc521d" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:03.425968 25546 consensus_queue.cc:1035] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c744db81895b44f2905d6377354389dd" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 45555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:03.429738 25560 mvcc.cc:205] Tried to move back new op lower bound from 7317721757386682368 to 7317721757274697728. Current Snapshot: MvccSnapshot[applied={T|T < 7317721757386682368}]
I20260812 16:46:03.430974 24639 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:03.431071 24639 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:03.432461 24639 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b88ebbf2911e438280d637cf7836647e: Sending DeleteTablet for 3 replicas of tablet aa2c8873b9c6499ba72a16b0c74823a6
I20260812 16:46:03.432833 24868 tablet_service.cc:1514] Processing DeleteTablet for tablet aa2c8873b9c6499ba72a16b0c74823a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:03 UTC) from {username='slave'} at 127.0.0.1:36304
I20260812 16:46:03.433082 25573 tablet_replica.cc:330] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: stopping tablet replica
I20260812 16:46:03.433079 25380 tablet_service.cc:1514] Processing DeleteTablet for tablet aa2c8873b9c6499ba72a16b0c74823a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:03 UTC) from {username='slave'} at 127.0.0.1:56722
I20260812 16:46:03.433182 25573 raft_consensus.cc:2229] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:46:03.433281 25573 raft_consensus.cc:2258] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:03.433736 25574 tablet_replica.cc:330] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: stopping tablet replica
I20260812 16:46:03.433817 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24745
I20260812 16:46:03.433830 25573 ts_tablet_manager.cc:1905] T aa2c8873b9c6499ba72a16b0c74823a6 P bed89b6371ca48edb09c9d8d24021291: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:03.433959 25574 raft_consensus.cc:2229] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:03.434127 25574 raft_consensus.cc:2258] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:03.435045 25574 ts_tablet_manager.cc:1905] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:03.437742 25574 ts_tablet_manager.cc:1918] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:03.437871 25574 log.cc:1196] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/aa2c8873b9c6499ba72a16b0c74823a6
I20260812 16:46:03.438179 25574 ts_tablet_manager.cc:1939] T aa2c8873b9c6499ba72a16b0c74823a6 P c744db81895b44f2905d6377354389dd: Deleting consensus metadata
I20260812 16:46:03.438668 24610 catalog_manager.cc:4841] TS c744db81895b44f2905d6377354389dd (127.21.114.67:45555): tablet aa2c8873b9c6499ba72a16b0c74823a6 (table test-table [id=c06785d333454203acbaffb9ec1bc1af]) successfully deleted
I20260812 16:46:03.440405 25133 tablet_service.cc:1514] Processing DeleteTablet for tablet aa2c8873b9c6499ba72a16b0c74823a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:03 UTC) from {username='slave'} at 127.0.0.1:41752
I20260812 16:46:03.441459 25575 tablet_replica.cc:330] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: stopping tablet replica
I20260812 16:46:03.441593 25575 raft_consensus.cc:2229] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:03.441712 25575 raft_consensus.cc:2258] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:03.442159 25575 ts_tablet_manager.cc:1905] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:03.443868 25575 ts_tablet_manager.cc:1918] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:03.443934 25575 log.cc:1196] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/aa2c8873b9c6499ba72a16b0c74823a6
I20260812 16:46:03.444159 25575 ts_tablet_manager.cc:1939] T aa2c8873b9c6499ba72a16b0c74823a6 P 14c7f34dec9e45b3bc326c9f14fc521d: Deleting consensus metadata
I20260812 16:46:03.445266 24611 catalog_manager.cc:4841] TS 14c7f34dec9e45b3bc326c9f14fc521d (127.21.114.66:38269): tablet aa2c8873b9c6499ba72a16b0c74823a6 (table test-table [id=c06785d333454203acbaffb9ec1bc1af]) successfully deleted
W20260812 16:46:03.449644 24609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:37101 (error 108)
I20260812 16:46:03.450204 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:03.450045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:37101 (local address 127.0.0.1:36314)
0812 16:46:03.450110 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:03.450160 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:37101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 16:46:03.450325 24609 catalog_manager.cc:4584] TS bed89b6371ca48edb09c9d8d24021291 (127.21.114.65:37101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa2c8873b9c6499ba72a16b0c74823a6: Network error: Client connection negotiation failed: client connection to 127.21.114.65:37101: connect: Connection refused (error 111)
I20260812 16:46:03.450336 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25000
I20260812 16:46:03.462700 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25267
I20260812 16:46:03.479925 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 24578
2026-08-12T16:46:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (832 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:03 dist-test-slave-45dx krb5kdc[25585](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:03 dist-test-slave-45dx krb5kdc[25585](info): set up 2 sockets
Aug 12 16:46:03 dist-test-slave-45dx krb5kdc[25585](info): commencing operation
krb5kdc: starting...
W20260812 16:46:04.799527 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:04 dist-test-slave-45dx krb5kdc[25585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:04.925501 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36709
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:36709
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:05.007961 25611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:05.008200 25611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:05.008242 25611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:05.009413 25611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:05.009483 25611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:05.009507 25611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:05.009531 25611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:05.009559 25611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:05.011029 25611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:36709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:05.011302 25611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:05.011538 25611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:05.016275 25621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:05.016285 25620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:05.016335 25623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.016355 25611 server_base.cc:1034] running on GCE node
I20260812 16:46:05.016816 25611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:05.017127 25611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:05.018276 25611 hybrid_clock.cc:648] HybridClock initialized: now 1786553165018258 us; error 41 us; skew 500 ppm
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:05.020850 25611 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:05.021215 25611 webserver.cc:460] Webserver started at http://127.21.114.126:35717/ using document root <none> and password file <none>
I20260812 16:46:05.021395 25611 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:05.021435 25611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:05.021518 25611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:05.022488 25611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "daa70d96d7a64a3abf1b9fd0d1587d20"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "82e44cfaabea76c09c2d68a9025d25fc"
server_key_iv: "48e4101640f702941203966aed44c48d"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.022779 25611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "daa70d96d7a64a3abf1b9fd0d1587d20"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "82e44cfaabea76c09c2d68a9025d25fc"
server_key_iv: "48e4101640f702941203966aed44c48d"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.024008 25611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 16:46:05.024737 25636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.024919 25611 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.025027 25611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "daa70d96d7a64a3abf1b9fd0d1587d20"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "82e44cfaabea76c09c2d68a9025d25fc"
server_key_iv: "48e4101640f702941203966aed44c48d"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.025102 25611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:05.055071 25611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:05.057343 25611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:05.057519 25611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:05.061578 25611 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:36709
I20260812 16:46:05.061621 25724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:36709 every 8 connection(s)
I20260812 16:46:05.062031 25611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:05.062991 25726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:05.065508 25726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20: Bootstrap starting.
I20260812 16:46:05.066171 25726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:05.066489 25726 log.cc:824] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:05.067230 25726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20: No bootstrap required, opened a new log
I20260812 16:46:05.068874 25726 raft_consensus.cc:348] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36709 } }
I20260812 16:46:05.069015 25726 raft_consensus.cc:374] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:05.069065 25726 raft_consensus.cc:729] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daa70d96d7a64a3abf1b9fd0d1587d20, State: Initialized, Role: FOLLOWER
I20260812 16:46:05.069240 25726 consensus_queue.cc:260] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36709 } }
I20260812 16:46:05.069327 25726 raft_consensus.cc:388] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:05.069377 25726 raft_consensus.cc:482] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:05.069428 25726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:05.069943 25726 raft_consensus.cc:504] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36709 } }
I20260812 16:46:05.070060 25726 leader_election.cc:302] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daa70d96d7a64a3abf1b9fd0d1587d20; no voters:
I20260812 16:46:05.070250 25726 leader_election.cc:288] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:05.070310 25730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:05.070485 25730 raft_consensus.cc:686] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [term 1 LEADER]: Becoming Leader. State: Replica: daa70d96d7a64a3abf1b9fd0d1587d20, State: Running, Role: LEADER
I20260812 16:46:05.070516 25726 sys_catalog.cc:564] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:05.070596 25730 consensus_queue.cc:237] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36709 } }
I20260812 16:46:05.071153 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25611
I20260812 16:46:05.071267 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:05.071286 25735 sys_catalog.cc:455] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daa70d96d7a64a3abf1b9fd0d1587d20. Latest consensus state: current_term: 1 leader_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36709 } } }
I20260812 16:46:05.071421 25735 sys_catalog.cc:458] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:05.071483 21961 external_mini_cluster.cc:1428] Setting key a8ce66d081c05ceab607428328770fd6
I20260812 16:46:05.071146 25734 sys_catalog.cc:455] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daa70d96d7a64a3abf1b9fd0d1587d20" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36709 } } }
I20260812 16:46:05.071831 25734 sys_catalog.cc:458] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:05.071996 25747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:05.072835 25747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:05.074481 25747 catalog_manager.cc:1347] Generated new cluster ID: 19c2e7271e444578be89e482482e9673
I20260812 16:46:05.074536 25747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:05.081904 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.071974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44196 (local address 127.21.114.126:36709)
0812 16:46:05.072262 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.072273 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.072325 (+ 52us) server_negotiation.cc:407] Connection header received
0812 16:46:05.072521 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.072527 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.072570 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.072703 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:05.073362 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.074658 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.075468 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.075931 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.076054 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.078486 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:05.078489 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:05.078490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:05.078502 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:05.080255 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.080685 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.080688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.080689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.080795 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.081014 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.081015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.081016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.081262 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:05.081435 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.081531 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.081676 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":62,"threads_started":1}
I20260812 16:46:05.084136 25747 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:05.084692 25747 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:05.088485 25747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20: Generated new TSK 0
I20260812 16:46:05.088673 25747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.114.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
Entry for principal kudu/127.21.114.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab.
I20260812 16:46:05.119084 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36709
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:05.202637 25772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:05.202847 25772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:05.202870 25772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:05.204082 25772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:05.204123 25772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:05.204149 25772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:46:05.205804 25772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.65.keytab
--principal=kudu/127.21.114.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:05.206054 25772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:05.206311 25772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:05.211423 25780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:05.211396 25783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.211607 25772 server_base.cc:1034] running on GCE node
W20260812 16:46:05.211725 25781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.211972 25772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:05.212177 25772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:05.213325 25772 hybrid_clock.cc:648] HybridClock initialized: now 1786553165213304 us; error 31 us; skew 500 ppm
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:05.215960 25772 init.cc:377] Logged in from keytab as kudu/127.21.114.65@KRBTEST.COM (short username kudu)
I20260812 16:46:05.216454 25772 webserver.cc:460] Webserver started at http://127.21.114.65:44433/ using document root <none> and password file <none>
I20260812 16:46:05.216704 25772 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:05.216777 25772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:05.216934 25772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:05.217993 25772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "c848413110a046c9aed46acbef5e6155"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "cafe6ec4cffc67fccce9107e05cdf067"
server_key_iv: "548acbad82696ea654c27f2a9c408f9a"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.218366 25772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "c848413110a046c9aed46acbef5e6155"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "cafe6ec4cffc67fccce9107e05cdf067"
server_key_iv: "548acbad82696ea654c27f2a9c408f9a"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.219702 25772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:05.220497 25791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.220674 25772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:05.220785 25772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "c848413110a046c9aed46acbef5e6155"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "cafe6ec4cffc67fccce9107e05cdf067"
server_key_iv: "548acbad82696ea654c27f2a9c408f9a"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.220882 25772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:05.240686 25772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:05.242653 25772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:05.242825 25772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:05.243076 25772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:05.243407 25772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:05.243463 25772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.243506 25772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:05.243533 25772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.249568 25772 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:37917
I20260812 16:46:05.249620 26026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:37917 every 8 connection(s)
I20260812 16:46:05.249950 25772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:46:05.254733 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 25772
I20260812 16:46:05.254830 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:46:05.255051 21961 external_mini_cluster.cc:1428] Setting key e0d444eee5d64dd6e6c33a542fe7da4d
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.65@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:05.260044 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.250707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:47107 (local address 127.21.114.126:36709)
0812 16:46:05.250799 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.250801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.251003 (+ 202us) server_negotiation.cc:407] Connection header received
0812 16:46:05.251545 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.251547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.251559 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.251625 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:05.252658 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.253179 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.254200 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.254428 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.254518 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.256830 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:05.256832 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:05.256833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:05.256843 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:05.258596 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.259005 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.259006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.259006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.259062 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.259352 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.259353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.259353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.259481 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:05.259563 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.259850 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.259955 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 16:46:05.260210 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.250675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36709 (local address 127.21.114.65:47107)
0812 16:46:05.250863 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.250910 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.251434 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.251697 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.251701 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.252328 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:05.252532 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.252538 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.253288 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.253289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.254096 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.254098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.254532 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.254533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.254671 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.255273 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:05.255281 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:05.256730 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:05.258688 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:05.258695 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:05.258696 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:05.258930 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:05.259146 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:05.259147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:05.259147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:05.259272 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:05.259552 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:05.259559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:05.259706 (+ 147us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.259812 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.259975 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
I20260812 16:46:05.260735 26027 heartbeater.cc:347] Connected to a master server at 127.21.114.126:36709
I20260812 16:46:05.260846 26027 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:05.261042 26027 heartbeater.cc:511] Master 127.21.114.126:36709 requested a full tablet report, sending...
I20260812 16:46:05.261600 25664 ts_manager.cc:194] Registered new tserver with Master: c848413110a046c9aed46acbef5e6155 (127.21.114.65:37917)
I20260812 16:46:05.262217 25664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.65@KRBTEST.COM'} at 127.21.114.65:47107
WARNING: no policy specified for kudu/127.21.114.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
Entry for principal kudu/127.21.114.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab.
I20260812 16:46:05.282821 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36709
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:05.367208 26033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:05.367424 26033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:05.367446 26033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:05.368696 26033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:05.368749 26033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:05.368777 26033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:46:05.370326 26033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.66.keytab
--principal=kudu/127.21.114.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:05.370536 26033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:05.370791 26033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:05.376106 26043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:05.376114 26040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.376217 26033 server_base.cc:1034] running on GCE node
W20260812 16:46:05.376125 26039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.376562 26033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:05.376811 26033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:05.377956 26033 hybrid_clock.cc:648] HybridClock initialized: now 1786553165377946 us; error 32 us; skew 500 ppm
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:05.380641 26033 init.cc:377] Logged in from keytab as kudu/127.21.114.66@KRBTEST.COM (short username kudu)
I20260812 16:46:05.381098 26033 webserver.cc:460] Webserver started at http://127.21.114.66:46451/ using document root <none> and password file <none>
I20260812 16:46:05.381356 26033 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:05.381436 26033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:05.381589 26033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:05.382678 26033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "a6fb667f6ba9fbb9888914e549e71609"
server_key_iv: "1dae5dae761d3fe2da0a20e4f7c234ce"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.383044 26033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "a6fb667f6ba9fbb9888914e549e71609"
server_key_iv: "1dae5dae761d3fe2da0a20e4f7c234ce"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.384451 26033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:46:05.385192 26055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.385360 26033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:05.385462 26033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "a6fb667f6ba9fbb9888914e549e71609"
server_key_iv: "1dae5dae761d3fe2da0a20e4f7c234ce"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.385545 26033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:05.414218 26033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:05.416181 26033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:05.416378 26033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:05.416646 26033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:05.416982 26033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:05.417037 26033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.417078 26033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:05.417119 26033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.423043 26033 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:40553
I20260812 16:46:05.423092 26278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:40553 every 8 connection(s)
I20260812 16:46:05.423426 26033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:46:05.428840 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 26033
I20260812 16:46:05.428988 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:46:05.429198 21961 external_mini_cluster.cc:1428] Setting key 8cd14c554183d193a2a33ecf63cd3c23
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.66@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:05.433859 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.424230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:49539 (local address 127.21.114.126:36709)
0812 16:46:05.424320 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.424322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.424553 (+ 231us) server_negotiation.cc:407] Connection header received
0812 16:46:05.425108 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.425109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.425120 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.425174 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:05.426103 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.426596 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.427671 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.427875 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.427926 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.430656 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:05.430658 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:05.430658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:05.430664 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:05.432375 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.432788 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.432789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.432790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.432861 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.433132 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.433133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.433133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.433280 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:05.433349 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.433623 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.433720 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 16:46:05.433876 26282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.424204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36709 (local address 127.21.114.66:49539)
0812 16:46:05.424426 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.424466 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.425014 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.425227 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.425230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.425820 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:05.426027 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.426031 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.426678 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.426679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.427599 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.427602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.427947 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.427948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.428057 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.428693 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:05.428705 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:05.430563 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:05.432470 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:05.432477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:05.432479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:05.432711 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:05.432940 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:05.432941 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:05.432941 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:05.433063 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:05.433345 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:05.433358 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:05.433475 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.433575 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.433705 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":132,"threads_started":1}
I20260812 16:46:05.434454 26279 heartbeater.cc:347] Connected to a master server at 127.21.114.126:36709
I20260812 16:46:05.434585 26279 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:05.434767 26279 heartbeater.cc:511] Master 127.21.114.126:36709 requested a full tablet report, sending...
I20260812 16:46:05.435232 25664 ts_manager.cc:194] Registered new tserver with Master: 6d42987baeb34b7aba8a7d2f5bbcf3fb (127.21.114.66:40553)
I20260812 16:46:05.435757 25664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.66@KRBTEST.COM'} at 127.21.114.66:49539
WARNING: no policy specified for kudu/127.21.114.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
Entry for principal kudu/127.21.114.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab.
I20260812 16:46:05.457247 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36709
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:05.542201 26287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:05.542394 26287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:05.542418 26287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:05.543491 26287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:05.543526 26287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:05.543550 26287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:46:05.544994 26287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.67.keytab
--principal=kudu/127.21.114.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:36709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:05.545183 26287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:05.545370 26287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:05.550486 26304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.550544 26287 server_base.cc:1034] running on GCE node
W20260812 16:46:05.550434 26294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:05.550438 26306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:05.550904 26287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:05.551158 26287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:05.552342 26287 hybrid_clock.cc:648] HybridClock initialized: now 1786553165552294 us; error 42 us; skew 500 ppm
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:05.554998 26287 init.cc:377] Logged in from keytab as kudu/127.21.114.67@KRBTEST.COM (short username kudu)
I20260812 16:46:05.555454 26287 webserver.cc:460] Webserver started at http://127.21.114.67:33859/ using document root <none> and password file <none>
I20260812 16:46:05.555704 26287 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:05.555751 26287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:05.555924 26287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:05.557061 26287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "c4984c16d0b24f3c8c148c74cbc55220"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "d2e723c4b2a1915b27fdf1c2a712ab54"
server_key_iv: "dc50ff8d0910d33ccfe9def022f26ed1"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.557461 26287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "c4984c16d0b24f3c8c148c74cbc55220"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "d2e723c4b2a1915b27fdf1c2a712ab54"
server_key_iv: "dc50ff8d0910d33ccfe9def022f26ed1"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.558876 26287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:05.559690 26325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.559899 26287 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:05.560014 26287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "c4984c16d0b24f3c8c148c74cbc55220"
format_stamp: "Formatted at 2026-08-12 16:46:05 on dist-test-slave-45dx"
server_key: "d2e723c4b2a1915b27fdf1c2a712ab54"
server_key_iv: "dc50ff8d0910d33ccfe9def022f26ed1"
server_key_version: "encryptionkey@0"
I20260812 16:46:05.560091 26287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:05.580546 26287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:05.583020 26287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:05.583190 26287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:05.583451 26287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:05.583771 26287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:05.583827 26287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.583873 26287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:05.583901 26287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:05.590201 26287 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:34201
I20260812 16:46:05.590245 26537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:34201 every 8 connection(s)
I20260812 16:46:05.590619 26287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:46:05.592773 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 26287
I20260812 16:46:05.592880 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:46:05.593065 21961 external_mini_cluster.cc:1428] Setting key f8cd09ee988bbb710dd7dbe88d38817e
Aug 12 16:46:05 dist-test-slave-45dx krb5kdc[25585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553165, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.67@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:05.599980 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.591388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:43335 (local address 127.21.114.126:36709)
0812 16:46:05.591466 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.591468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.591642 (+ 174us) server_negotiation.cc:407] Connection header received
0812 16:46:05.592116 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.592117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.592128 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.592183 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:05.593437 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.593945 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.595023 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.595234 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.595323 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.597536 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:05.597537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:05.597538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:05.597545 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:05.598790 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.599160 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.599160 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.599161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.599213 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.599449 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.599450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.599450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.599552 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:05.599615 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.599857 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.599916 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 16:46:05.600200 26547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.591336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:36709 (local address 127.21.114.67:43335)
0812 16:46:05.591513 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.591550 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.592029 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.592237 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.592240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.593045 (+ 805us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:05.593314 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.593320 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.594048 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.594049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.594913 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.594916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.595334 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.595335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.595470 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.595996 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:05.596005 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:05.597452 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:05.598866 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:05.598872 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:05.598873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:05.599093 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:05.599291 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:05.599292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:05.599292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:05.599393 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:05.599620 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:05.599624 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:05.599738 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.599819 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.599965 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":111,"threads_started":1}
I20260812 16:46:05.600713 26541 heartbeater.cc:347] Connected to a master server at 127.21.114.126:36709
I20260812 16:46:05.600807 26541 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:05.600973 26541 heartbeater.cc:511] Master 127.21.114.126:36709 requested a full tablet report, sending...
I20260812 16:46:05.601321 25664 ts_manager.cc:194] Registered new tserver with Master: c4984c16d0b24f3c8c148c74cbc55220 (127.21.114.67:34201)
I20260812 16:46:05.601655 25664 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.114.67@KRBTEST.COM'} at 127.21.114.67:43335
I20260812 16:46:05.604641 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:46:05.611743 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.606031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.21.114.126:36709)
0812 16:46:05.606093 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.606095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.606224 (+ 129us) server_negotiation.cc:407] Connection header received
0812 16:46:05.606260 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.606261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.606269 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.606313 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:05.606954 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.607411 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.608164 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.608386 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.608436 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.609467 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:05.609468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:05.609468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:05.609474 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:05.610824 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.611137 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.611137 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.611138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.611187 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:05.611314 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:05.611315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:05.611315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:05.611440 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:05.611512 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.611605 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.611659 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 16:46:05.613651 25664 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44198:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:46:05.615201 25664 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:46:05.621994 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.617778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.21.114.66:40553)
0812 16:46:05.618156 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.618162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.618175 (+ 13us) server_negotiation.cc:407] Connection header received
0812 16:46:05.618220 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.618222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.618238 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.618323 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:05.618619 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.619772 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.620884 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.621548 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621638 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.621703 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.621869 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.621911 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":111,"threads_started":1}
I20260812 16:46:05.622025 26566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.617665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40553 (local address 127.0.0.1:51910)
0812 16:46:05.617851 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.617897 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.617963 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.618443 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.618447 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.618450 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:05.618530 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.618532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.619921 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.619922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.620780 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.620783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.621638 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.621721 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.621748 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.621847 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.621901 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":4,"thread_start_us":69,"threads_started":1}
I20260812 16:46:05.622121 26565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.617692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:34201 (local address 127.0.0.1:45484)
0812 16:46:05.617971 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.617980 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.618023 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.618549 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.618549 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.618552 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:05.618608 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.618610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.619550 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.619551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.620828 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.620831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.621890 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.621955 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.621959 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.621990 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.622033 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":82,"threads_started":1}
I20260812 16:46:05.622608 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.617875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:37917 (local address 127.0.0.1:60532)
0812 16:46:05.618069 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.618077 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.618110 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.618457 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.618458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.618460 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:05.618530 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.618532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.619886 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.619887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.620967 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.620969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.621948 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621948 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.622017 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.622020 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.622491 (+ 471us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.622536 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":9,"thread_start_us":71,"threads_started":1}
I20260812 16:46:05.622786 26154 tablet_service.cc:1467] Processing CreateTablet for tablet b366f590664e4aed940e8acd7d59e8f8 (DEFAULT_TABLE table=test-table [id=d9fad42189e24b7ca650110a50a33732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:05.622963 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.618110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60532 (local address 127.21.114.65:37917)
0812 16:46:05.618306 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.618309 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.618319 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:46:05.618358 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.618360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.618373 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.618445 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:05.618620 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.619784 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621039 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.621792 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621859 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.621920 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.622808 (+ 888us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.622882 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260812 16:46:05.623194 26154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b366f590664e4aed940e8acd7d59e8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:05.623579 25903 tablet_service.cc:1467] Processing CreateTablet for tablet b366f590664e4aed940e8acd7d59e8f8 (DEFAULT_TABLE table=test-table [id=d9fad42189e24b7ca650110a50a33732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:05.623827 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b366f590664e4aed940e8acd7d59e8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:05.625916 26572 tablet_bootstrap.cc:492] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Bootstrap starting.
I20260812 16:46:05.626197 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.617792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.21.114.67:34201)
0812 16:46:05.618239 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.618243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.618254 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:05.618304 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.618306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.618323 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.618701 (+ 378us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:05.618781 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.619439 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.621054 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.621782 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.625965 (+ 4183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.626039 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.626069 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.626116 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":99,"threads_started":1}
I20260812 16:46:05.626858 26572 tablet_bootstrap.cc:654] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:05.626894 26575 tablet_bootstrap.cc:492] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: Bootstrap starting.
I20260812 16:46:05.626904 26412 tablet_service.cc:1467] Processing CreateTablet for tablet b366f590664e4aed940e8acd7d59e8f8 (DEFAULT_TABLE table=test-table [id=d9fad42189e24b7ca650110a50a33732]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:05.627260 26412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b366f590664e4aed940e8acd7d59e8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:05.627595 26575 tablet_bootstrap.cc:654] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:05.627583 26572 log.cc:824] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:05.628274 26575 log.cc:824] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:05.628564 26572 tablet_bootstrap.cc:492] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: No bootstrap required, opened a new log
I20260812 16:46:05.628643 26572 ts_tablet_manager.cc:1397] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:46:05.629133 26575 tablet_bootstrap.cc:492] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: No bootstrap required, opened a new log
I20260812 16:46:05.629217 26575 ts_tablet_manager.cc:1397] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 16:46:05.630673 26579 tablet_bootstrap.cc:492] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Bootstrap starting.
I20260812 16:46:05.630765 26572 raft_consensus.cc:348] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.630981 26572 raft_consensus.cc:374] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:05.631029 26572 raft_consensus.cc:729] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d42987baeb34b7aba8a7d2f5bbcf3fb, State: Initialized, Role: FOLLOWER
I20260812 16:46:05.630921 26575 raft_consensus.cc:348] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.631129 26575 raft_consensus.cc:374] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:05.631170 26575 raft_consensus.cc:729] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c848413110a046c9aed46acbef5e6155, State: Initialized, Role: FOLLOWER
I20260812 16:46:05.631182 26572 consensus_queue.cc:260] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.631312 26575 consensus_queue.cc:260] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.631420 26579 tablet_bootstrap.cc:654] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:05.631462 26572 ts_tablet_manager.cc:1428] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:46:05.631587 26279 heartbeater.cc:503] Master 127.21.114.126:36709 was elected leader, sending a full tablet report...
I20260812 16:46:05.631630 26575 ts_tablet_manager.cc:1428] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 16:46:05.631652 26027 heartbeater.cc:503] Master 127.21.114.126:36709 was elected leader, sending a full tablet report...
I20260812 16:46:05.632045 26579 log.cc:824] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:05.632978 26579 tablet_bootstrap.cc:492] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: No bootstrap required, opened a new log
I20260812 16:46:05.633065 26579 ts_tablet_manager.cc:1397] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:05.634382 26579 raft_consensus.cc:348] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.634541 26579 raft_consensus.cc:374] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:05.634588 26579 raft_consensus.cc:729] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4984c16d0b24f3c8c148c74cbc55220, State: Initialized, Role: FOLLOWER
I20260812 16:46:05.634706 26579 consensus_queue.cc:260] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.635015 26579 ts_tablet_manager.cc:1428] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:05.635028 26541 heartbeater.cc:503] Master 127.21.114.126:36709 was elected leader, sending a full tablet report...
W20260812 16:46:05.674091 26280 tablet.cc:2369] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 16:46:05.750680 26028 tablet.cc:2369] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:05.809859 26583 raft_consensus.cc:482] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:46:05.809983 26583 raft_consensus.cc:504] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.810408 26583 leader_election.cc:288] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d42987baeb34b7aba8a7d2f5bbcf3fb (127.21.114.66:40553), c4984c16d0b24f3c8c148c74cbc55220 (127.21.114.67:34201)
I20260812 16:46:05.813452 26587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.810595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:34201 (local address 127.21.114.65:54109)
0812 16:46:05.810748 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.810764 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.810839 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.810973 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.810974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.810977 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:05.811068 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.811070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.811733 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.811734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.812567 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.812570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.813148 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.813149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.813223 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.813228 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.813316 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.813360 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
I20260812 16:46:05.813439 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.810694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:54109 (local address 127.21.114.67:34201)
0812 16:46:05.810746 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.810749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.810837 (+ 88us) server_negotiation.cc:407] Connection header received
0812 16:46:05.810894 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.810895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.810905 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.810964 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:05.811144 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.811644 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.812658 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.813061 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.813121 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.813129 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.813326 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.813366 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:46:05.813515 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.810703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:60755 (local address 127.21.114.66:40553)
0812 16:46:05.810787 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.810789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.810905 (+ 116us) server_negotiation.cc:407] Connection header received
0812 16:46:05.810962 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.810963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.810973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.811029 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:05.811221 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.811694 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.812708 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.813085 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.813182 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.813190 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.813392 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.813442 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 16:46:05.813763 26588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.810595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:40553 (local address 127.21.114.65:60755)
0812 16:46:05.810785 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.810803 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:05.810901 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:05.811050 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:05.811051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:05.811052 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:05.811147 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.811149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.811784 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.811785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.812596 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:05.812599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.813202 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.813203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:05.813280 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.813284 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 16:46:05.813607 (+ 323us) client_negotiation.cc:240] Negotiation successful
0812 16:46:05.813663 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":2,"thread_start_us":66,"threads_started":1}
I20260812 16:46:05.814070 26445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b366f590664e4aed940e8acd7d59e8f8" candidate_uuid: "c848413110a046c9aed46acbef5e6155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4984c16d0b24f3c8c148c74cbc55220" is_pre_election: true
I20260812 16:46:05.814126 26196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b366f590664e4aed940e8acd7d59e8f8" candidate_uuid: "c848413110a046c9aed46acbef5e6155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" is_pre_election: true
I20260812 16:46:05.814242 26196 raft_consensus.cc:2454] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c848413110a046c9aed46acbef5e6155 in term 0.
I20260812 16:46:05.814242 26445 raft_consensus.cc:2454] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c848413110a046c9aed46acbef5e6155 in term 0.
I20260812 16:46:05.814497 25797 leader_election.cc:302] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4984c16d0b24f3c8c148c74cbc55220, c848413110a046c9aed46acbef5e6155; no voters:
I20260812 16:46:05.814664 26583 raft_consensus.cc:2781] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:46:05.814744 26583 raft_consensus.cc:482] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:46:05.814782 26583 raft_consensus.cc:3037] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:05.815523 26583 raft_consensus.cc:504] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.815683 26583 leader_election.cc:288] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [CANDIDATE]: Term 1 election: Requested vote from peers 6d42987baeb34b7aba8a7d2f5bbcf3fb (127.21.114.66:40553), c4984c16d0b24f3c8c148c74cbc55220 (127.21.114.67:34201)
I20260812 16:46:05.815850 26196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b366f590664e4aed940e8acd7d59e8f8" candidate_uuid: "c848413110a046c9aed46acbef5e6155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb"
I20260812 16:46:05.815860 26445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b366f590664e4aed940e8acd7d59e8f8" candidate_uuid: "c848413110a046c9aed46acbef5e6155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4984c16d0b24f3c8c148c74cbc55220"
I20260812 16:46:05.815941 26196 raft_consensus.cc:3037] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:05.815941 26445 raft_consensus.cc:3037] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:05.816898 26445 raft_consensus.cc:2454] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c848413110a046c9aed46acbef5e6155 in term 1.
I20260812 16:46:05.816890 26196 raft_consensus.cc:2454] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c848413110a046c9aed46acbef5e6155 in term 1.
I20260812 16:46:05.817101 25795 leader_election.cc:302] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d42987baeb34b7aba8a7d2f5bbcf3fb, c848413110a046c9aed46acbef5e6155; no voters:
I20260812 16:46:05.817224 26583 raft_consensus.cc:2781] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:05.817384 26583 raft_consensus.cc:686] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 1 LEADER]: Becoming Leader. State: Replica: c848413110a046c9aed46acbef5e6155, State: Running, Role: LEADER
I20260812 16:46:05.817500 26583 consensus_queue.cc:237] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } }
I20260812 16:46:05.818392 25664 catalog_manager.cc:5495] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 reported cstate change: term changed from 0 to 1, leader changed from <none> to c848413110a046c9aed46acbef5e6155 (127.21.114.65). New cstate: current_term: 1 leader_uuid: "c848413110a046c9aed46acbef5e6155" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c848413110a046c9aed46acbef5e6155" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 37917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 } health_report { overall_health: UNKNOWN } } }
W20260812 16:46:05.841213 26546 tablet.cc:2369] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:05.851227 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.849028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60540 (local address 127.21.114.65:37917)
0812 16:46:05.849103 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:05.849104 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:05.849114 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:46:05.849152 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:05.849153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:05.849171 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:05.849233 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:05.849375 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.849835 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.850566 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:05.850747 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:05.850797 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:05.850952 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:05.851051 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:05.851112 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:05.851151 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 16:46:05.851169 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:46:05.853125 26445 raft_consensus.cc:1261] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 1 FOLLOWER]: Refusing update from remote peer c848413110a046c9aed46acbef5e6155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:05.853157 26196 raft_consensus.cc:1261] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 1 FOLLOWER]: Refusing update from remote peer c848413110a046c9aed46acbef5e6155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:05.853513 26583 consensus_queue.cc:1035] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4984c16d0b24f3c8c148c74cbc55220" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:05.853688 26589 consensus_queue.cc:1035] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d42987baeb34b7aba8a7d2f5bbcf3fb" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:05.855899 26594 mvcc.cc:205] Tried to move back new op lower bound from 7317721767331651584 to 7317721767189168128. Current Snapshot: MvccSnapshot[applied={T|T < 7317721767331651584}]
I20260812 16:46:05.856122 26596 mvcc.cc:205] Tried to move back new op lower bound from 7317721767331651584 to 7317721767189168128. Current Snapshot: MvccSnapshot[applied={T|T < 7317721767331651584}]
I20260812 16:46:05.856225 26597 mvcc.cc:205] Tried to move back new op lower bound from 7317721767331651584 to 7317721767189168128. Current Snapshot: MvccSnapshot[applied={T|T < 7317721767331651584}]
I20260812 16:46:05.858904 25664 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:05.859014 25664 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:05.859776 25664 catalog_manager.cc:5782] T 00000000000000000000000000000000 P daa70d96d7a64a3abf1b9fd0d1587d20: Sending DeleteTablet for 3 replicas of tablet b366f590664e4aed940e8acd7d59e8f8
I20260812 16:46:05.860113 26154 tablet_service.cc:1514] Processing DeleteTablet for tablet b366f590664e4aed940e8acd7d59e8f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:05 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:51910
I20260812 16:46:05.860121 25903 tablet_service.cc:1514] Processing DeleteTablet for tablet b366f590664e4aed940e8acd7d59e8f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:05 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:60532
I20260812 16:46:05.860422 26621 tablet_replica.cc:330] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155: stopping tablet replica
I20260812 16:46:05.860404 26412 tablet_service.cc:1514] Processing DeleteTablet for tablet b366f590664e4aed940e8acd7d59e8f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:05 UTC) from {username='kudu', principal='kudu/127.21.114.126@KRBTEST.COM'} at 127.0.0.1:45484
I20260812 16:46:05.860530 26621 raft_consensus.cc:2229] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:46:05.860672 26621 raft_consensus.cc:2258] T b366f590664e4aed940e8acd7d59e8f8 P c848413110a046c9aed46acbef5e6155 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:05.860674 26622 tablet_replica.cc:330] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: stopping tablet replica
I20260812 16:46:05.860922 26620 tablet_replica.cc:330] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: stopping tablet replica
I20260812 16:46:05.860991 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25772
I20260812 16:46:05.861027 26620 raft_consensus.cc:2229] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:05.861119 26620 raft_consensus.cc:2258] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:05.865412 26620 ts_tablet_manager.cc:1905] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:05.867527 26620 ts_tablet_manager.cc:1918] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:05.867532 26622 raft_consensus.cc:2229] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:05.867609 26620 log.cc:1196] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-1/wal/wals/b366f590664e4aed940e8acd7d59e8f8
I20260812 16:46:05.867691 26622 raft_consensus.cc:2258] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:05.868064 26620 ts_tablet_manager.cc:1939] T b366f590664e4aed940e8acd7d59e8f8 P 6d42987baeb34b7aba8a7d2f5bbcf3fb: Deleting consensus metadata
I20260812 16:46:05.868243 26622 ts_tablet_manager.cc:1905] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:05.868559 25644 catalog_manager.cc:4841] TS 6d42987baeb34b7aba8a7d2f5bbcf3fb (127.21.114.66:40553): tablet b366f590664e4aed940e8acd7d59e8f8 (table test-table [id=d9fad42189e24b7ca650110a50a33732]) successfully deleted
I20260812 16:46:05.870267 26622 ts_tablet_manager.cc:1918] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:05.870348 26622 log.cc:1196] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/b366f590664e4aed940e8acd7d59e8f8
I20260812 16:46:05.870661 26622 ts_tablet_manager.cc:1939] T b366f590664e4aed940e8acd7d59e8f8 P c4984c16d0b24f3c8c148c74cbc55220: Deleting consensus metadata
I20260812 16:46:05.871119 25647 catalog_manager.cc:4841] TS c4984c16d0b24f3c8c148c74cbc55220 (127.21.114.67:34201): tablet b366f590664e4aed940e8acd7d59e8f8 (table test-table [id=d9fad42189e24b7ca650110a50a33732]) successfully deleted
W20260812 16:46:05.873167 25644 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:37917 (error 108)
I20260812 16:46:05.873458 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 26033
I20260812 16:46:05.874289 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:05.873649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:37917 (local address 127.0.0.1:60554)
0812 16:46:05.874195 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:05.874243 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":519}
W20260812 16:46:05.874459 25644 catalog_manager.cc:4584] TS c848413110a046c9aed46acbef5e6155 (127.21.114.65:37917): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b366f590664e4aed940e8acd7d59e8f8: Network error: Client connection negotiation failed: client connection to 127.21.114.65:37917: connect: Connection refused (error 111)
I20260812 16:46:05.882155 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 26287
I20260812 16:46:05.902187 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 25611
2026-08-12T16:46:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2424 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T16:46:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:05Z Disabled control of system clock
I20260812 16:46:05.938623 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37987
--webserver_interface=127.21.114.126
--webserver_port=0
--builtin_ntp_servers=127.21.114.84:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:37987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:46:06.022253 26635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:06.022477 26635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:06.022498 26635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:06.023666 26635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:06.023710 26635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:06.023722 26635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:06.023736 26635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:06.023792 26635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:06.025147 26635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:37987
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:37987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:06.025403 26635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:06.025724 26635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:06.030786 26650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:06.030776 26643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:06.030812 26635 server_base.cc:1034] running on GCE node
W20260812 16:46:06.030779 26648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:06.031330 26635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:06.031646 26635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:06.032791 26635 hybrid_clock.cc:648] HybridClock initialized: now 1786553166032779 us; error 32 us; skew 500 ppm
I20260812 16:46:06.034147 26635 webserver.cc:460] Webserver started at http://127.21.114.126:45811/ using document root <none> and password file <none>
I20260812 16:46:06.034420 26635 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:06.034473 26635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:06.034659 26635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:06.035753 26635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "2ed4ceeaa1a942bf94952bd113bf9468"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "41fbb764255103c9c8f790266bf31a47"
server_key_iv: "a1c88f63694d2ed12a70e4255eae6f82"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.036144 26635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "2ed4ceeaa1a942bf94952bd113bf9468"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "41fbb764255103c9c8f790266bf31a47"
server_key_iv: "a1c88f63694d2ed12a70e4255eae6f82"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.037524 26635 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:06.038264 26659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.038458 26635 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:46:06.038556 26635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "2ed4ceeaa1a942bf94952bd113bf9468"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "41fbb764255103c9c8f790266bf31a47"
server_key_iv: "a1c88f63694d2ed12a70e4255eae6f82"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.038635 26635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:06.052562 26635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:06.052922 26635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:06.053107 26635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:06.057359 26635 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:37987
I20260812 16:46:06.057394 26766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:37987 every 8 connection(s)
I20260812 16:46:06.057755 26635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:06.058737 26767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:06.061156 26767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468: Bootstrap starting.
I20260812 16:46:06.061772 26767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:06.062101 26767 log.cc:824] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:06.062798 26767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468: No bootstrap required, opened a new log
I20260812 16:46:06.063216 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 26635
I20260812 16:46:06.063336 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:06.063519 21961 external_mini_cluster.cc:1428] Setting key 6bd19d4e0f7b29e3e2ddba0c41d9306d
I20260812 16:46:06.065135 26767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:46:06.065311 26767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:06.065348 26767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed4ceeaa1a942bf94952bd113bf9468, State: Initialized, Role: FOLLOWER
I20260812 16:46:06.065487 26767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:46:06.065603 26767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:06.065639 26767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:06.065692 26767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:06.066432 26767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:46:06.066542 26767 leader_election.cc:302] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ed4ceeaa1a942bf94952bd113bf9468; no voters:
I20260812 16:46:06.066702 26767 leader_election.cc:288] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:06.066781 26778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:06.066941 26778 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [term 1 LEADER]: Becoming Leader. State: Replica: 2ed4ceeaa1a942bf94952bd113bf9468, State: Running, Role: LEADER
I20260812 16:46:06.066947 26767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:06.067041 26778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } }
I20260812 16:46:06.067394 26781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } } }
I20260812 16:46:06.067381 26778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed4ceeaa1a942bf94952bd113bf9468. Latest consensus state: current_term: 1 leader_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4ceeaa1a942bf94952bd113bf9468" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 37987 } } }
I20260812 16:46:06.067487 26781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:06.067493 26778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:06.067709 26792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:06.068219 26792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:06.070281 26792 catalog_manager.cc:1347] Generated new cluster ID: 1d05e28adcb340dfb8b31db2120280ea
I20260812 16:46:06.070345 26792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:06.070771 26776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.064134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.21.114.126:37987)
0812 16:46:06.064388 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.064397 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.064490 (+ 93us) server_negotiation.cc:407] Connection header received
0812 16:46:06.065085 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.065095 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.065177 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.065345 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:06.065585 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.067366 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.068705 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.069153 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.069291 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.070041 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:06.070045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:06.070045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:06.070268 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:06.070314 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:06.070329 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:06.070406 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.070504 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.070583 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":101,"threads_started":1}
I20260812 16:46:06.085786 26792 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:06.086328 26792 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:06.093552 26792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468: Generated new TSK 0
I20260812 16:46:06.093755 26792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:06.097602 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.65:0
--local_ip_for_outbound_sockets=127.21.114.65
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--builtin_ntp_servers=127.21.114.84:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:46:06.183516 26814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:06.183732 26814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:06.183754 26814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:06.184998 26814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:06.185041 26814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:06.185067 26814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.65
I20260812 16:46:06.186436 26814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.114.65
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.65
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:06.186694 26814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:06.187036 26814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:06.193019 26825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:06.193095 26826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:06.193116 26828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:06.193427 26814 server_base.cc:1034] running on GCE node
I20260812 16:46:06.193643 26814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:06.193888 26814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:06.195075 26814 hybrid_clock.cc:648] HybridClock initialized: now 1786553166195054 us; error 35 us; skew 500 ppm
I20260812 16:46:06.196553 26814 webserver.cc:460] Webserver started at http://127.21.114.65:41633/ using document root <none> and password file <none>
I20260812 16:46:06.196805 26814 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:06.196893 26814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:06.197063 26814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:06.198191 26814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data/instance:
uuid: "c9c825e231e34cadac5d212bc3374b12"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "e8e092adad86f543410bda3ac306282f"
server_key_iv: "c0294263b83be1f0194bf762027a6aac"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.198589 26814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance:
uuid: "c9c825e231e34cadac5d212bc3374b12"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "e8e092adad86f543410bda3ac306282f"
server_key_iv: "c0294263b83be1f0194bf762027a6aac"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.199992 26814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:06.200850 26842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.201048 26814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:46:06.201164 26814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal
uuid: "c9c825e231e34cadac5d212bc3374b12"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "e8e092adad86f543410bda3ac306282f"
server_key_iv: "c0294263b83be1f0194bf762027a6aac"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.201242 26814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:06.221307 26814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:06.221824 26814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:06.222023 26814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:06.222302 26814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:06.222697 26814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:06.222770 26814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.222821 26814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:06.222849 26814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.229774 26814 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.65:39353
I20260812 16:46:06.229833 27039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.65:39353 every 8 connection(s)
I20260812 16:46:06.230173 26814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/data/info.pb
I20260812 16:46:06.233745 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 26814
I20260812 16:46:06.233836 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-0/wal/instance
I20260812 16:46:06.234045 21961 external_mini_cluster.cc:1428] Setting key c2cab88787acdf696b21f010e92c0205
I20260812 16:46:06.235091 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.66:0
--local_ip_for_outbound_sockets=127.21.114.66
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--builtin_ntp_servers=127.21.114.84:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 16:46:06.235987 26776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.230920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.65:58225 (local address 127.21.114.126:37987)
0812 16:46:06.230992 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.230994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.231268 (+ 274us) server_negotiation.cc:407] Connection header received
0812 16:46:06.231822 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.231824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.231843 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.231898 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:06.232689 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.233196 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.234444 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.234699 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.234772 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.235688 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:06.235690 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:06.235690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:06.235695 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:06.235714 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:06.235719 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:06.235779 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.235835 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.235866 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:46:06.236135 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.230922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37987 (local address 127.21.114.65:58225)
0812 16:46:06.231124 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.231160 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.231693 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.231970 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.231975 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.231994 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:06.232582 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.232587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.233301 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.233302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.234361 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.234364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.234799 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.234800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.234946 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.235539 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:46:06.235540 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:06.235570 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:46:06.235594 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:06.235782 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:06.235785 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:06.235787 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.235834 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.235920 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":75,"threads_started":1}
I20260812 16:46:06.236697 27041 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37987
I20260812 16:46:06.236814 27041 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:06.237011 27041 heartbeater.cc:511] Master 127.21.114.126:37987 requested a full tablet report, sending...
I20260812 16:46:06.237540 26698 ts_manager.cc:194] Registered new tserver with Master: c9c825e231e34cadac5d212bc3374b12 (127.21.114.65:39353)
I20260812 16:46:06.238461 26698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.65:58225
W20260812 16:46:06.320250 27044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:06.320466 27044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:06.320487 27044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:06.321623 27044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:06.321666 27044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:06.321691 27044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.66
I20260812 16:46:06.322970 27044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.114.66
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.66
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:06.323146 27044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:06.323377 27044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:06.328395 27058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:06.328343 27053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:06.328347 27051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:06.328567 27044 server_base.cc:1034] running on GCE node
I20260812 16:46:06.328810 27044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:06.329066 27044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:06.330255 27044 hybrid_clock.cc:648] HybridClock initialized: now 1786553166330233 us; error 31 us; skew 500 ppm
I20260812 16:46:06.331627 27044 webserver.cc:460] Webserver started at http://127.21.114.66:45121/ using document root <none> and password file <none>
I20260812 16:46:06.331872 27044 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:06.331964 27044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:06.332121 27044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:06.333240 27044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data/instance:
uuid: "217499ed5d334148a09b2b74771cdd8a"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "dccc71b0c255d1d996fbcaefc810b698"
server_key_iv: "4861e09124a311e9cb6e0dd027ac3231"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.333608 27044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance:
uuid: "217499ed5d334148a09b2b74771cdd8a"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "dccc71b0c255d1d996fbcaefc810b698"
server_key_iv: "4861e09124a311e9cb6e0dd027ac3231"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.334952 27044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:06.335649 27068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.335829 27044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:06.335948 27044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal
uuid: "217499ed5d334148a09b2b74771cdd8a"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "dccc71b0c255d1d996fbcaefc810b698"
server_key_iv: "4861e09124a311e9cb6e0dd027ac3231"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.336035 27044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:06.365815 27044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:06.366191 27044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:06.366371 27044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:06.366642 27044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:06.367040 27044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:06.367106 27044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.367149 27044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:06.367177 27044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.373019 27044 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.66:39931
I20260812 16:46:06.373065 27272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.66:39931 every 8 connection(s)
I20260812 16:46:06.373432 27044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/data/info.pb
I20260812 16:46:06.378679 26776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.374222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.66:54079 (local address 127.21.114.126:37987)
0812 16:46:06.374275 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.374278 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.374552 (+ 274us) server_negotiation.cc:407] Connection header received
0812 16:46:06.375129 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.375131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.375140 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.375196 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:06.375877 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.376386 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.377419 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.377597 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.377647 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.378450 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:06.378451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:06.378452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:06.378456 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:06.378469 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:06.378473 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:06.378516 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.378596 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.378618 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:46:06.378886 27276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.374223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37987 (local address 127.21.114.66:54079)
0812 16:46:06.374427 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.374462 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.375037 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.375269 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.375272 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.375281 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:06.375804 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.375809 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.376474 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.376474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.377331 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.377333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.377675 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.377676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.377789 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.378304 (+ 515us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:46:06.378305 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:06.378334 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:46:06.378369 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:06.378528 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:06.378532 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:06.378534 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.378586 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.378669 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260812 16:46:06.379400 27274 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37987
I20260812 16:46:06.379493 27274 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:06.379637 27274 heartbeater.cc:511] Master 127.21.114.126:37987 requested a full tablet report, sending...
I20260812 16:46:06.380021 26698 ts_manager.cc:194] Registered new tserver with Master: 217499ed5d334148a09b2b74771cdd8a (127.21.114.66:39931)
I20260812 16:46:06.380426 26698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.66:54079
I20260812 16:46:06.381618 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27044
I20260812 16:46:06.381757 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-1/wal/instance
I20260812 16:46:06.381961 21961 external_mini_cluster.cc:1428] Setting key f6e65b9ae87ffbf3bcd1e0c5e23a9cb2
I20260812 16:46:06.382812 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.114.67:0
--local_ip_for_outbound_sockets=127.21.114.67
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--builtin_ntp_servers=127.21.114.84:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 16:46:06.465281 27277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:06.465523 27277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:06.465557 27277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:06.466761 27277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:06.466816 27277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:06.466856 27277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.114.67
I20260812 16:46:06.468564 27277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.114.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.114.67
--webserver_port=0
--tserver_master_addrs=127.21.114.126:37987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.114.67
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:06.468845 27277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:06.469190 27277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:06.474327 27287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:06.474337 27286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:06.474525 27277 server_base.cc:1034] running on GCE node
W20260812 16:46:06.474337 27290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:06.474792 27277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:06.475059 27277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:06.476203 27277 hybrid_clock.cc:648] HybridClock initialized: now 1786553166476195 us; error 31 us; skew 500 ppm
I20260812 16:46:06.477490 27277 webserver.cc:460] Webserver started at http://127.21.114.67:35501/ using document root <none> and password file <none>
I20260812 16:46:06.477789 27277 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:06.477887 27277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:06.478044 27277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:06.479146 27277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data/instance:
uuid: "66aedb7f3fca4aa49478955f27a57c56"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "5e4539ec3bb9796c91a1175c7b7207df"
server_key_iv: "c9d48c88d7100b1985cb20690862063e"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.479521 27277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance:
uuid: "66aedb7f3fca4aa49478955f27a57c56"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "5e4539ec3bb9796c91a1175c7b7207df"
server_key_iv: "c9d48c88d7100b1985cb20690862063e"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.480983 27277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:06.481690 27299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.481894 27277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:06.482008 27277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal
uuid: "66aedb7f3fca4aa49478955f27a57c56"
format_stamp: "Formatted at 2026-08-12 16:46:06 on dist-test-slave-45dx"
server_key: "5e4539ec3bb9796c91a1175c7b7207df"
server_key_iv: "c9d48c88d7100b1985cb20690862063e"
server_key_version: "encryptionkey@0"
I20260812 16:46:06.482087 27277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:06.494867 27277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:06.495172 27277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:06.495321 27277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:06.495537 27277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 16:46:06.495863 27277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 16:46:06.495922 27277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.495965 27277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 16:46:06.495991 27277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:06.502799 27277 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.67:37809
I20260812 16:46:06.502837 27515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.67:37809 every 8 connection(s)
I20260812 16:46:06.503218 27277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/data/info.pb
I20260812 16:46:06.508365 26776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.504025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:55517 (local address 127.21.114.126:37987)
0812 16:46:06.504072 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.504074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.504293 (+ 219us) server_negotiation.cc:407] Connection header received
0812 16:46:06.504835 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.504836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.504847 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.504908 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:06.505551 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.506039 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.506960 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.507135 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.507185 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.508029 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:06.508030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:06.508031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:06.508034 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:06.508046 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:06.508049 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:06.508124 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.508227 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.508256 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:46:06.508376 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27277
I20260812 16:46:06.508498 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal/instance
I20260812 16:46:06.508690 21961 external_mini_cluster.cc:1428] Setting key 746f13c611935346bb8b3d7651582df5
I20260812 16:46:06.508728 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.504003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:37987 (local address 127.21.114.67:55517)
0812 16:46:06.504168 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.504200 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.504749 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.504970 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.504973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.504981 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:06.505483 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.505487 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.506116 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.506117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.506881 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.506882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.507205 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.507206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.507315 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.507905 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 16:46:06.507905 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:06.507933 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 16:46:06.507956 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:06.508123 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:06.508126 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:06.508128 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.508223 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.508340 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260812 16:46:06.509347 27517 heartbeater.cc:347] Connected to a master server at 127.21.114.126:37987
I20260812 16:46:06.509460 27517 heartbeater.cc:464] Registering TS with master...
I20260812 16:46:06.509644 27517 heartbeater.cc:511] Master 127.21.114.126:37987 requested a full tablet report, sending...
I20260812 16:46:06.509994 26696 ts_manager.cc:194] Registered new tserver with Master: 66aedb7f3fca4aa49478955f27a57c56 (127.21.114.67:37809)
I20260812 16:46:06.510370 26696 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.114.67:55517
I20260812 16:46:06.520845 21961 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 16:46:06.525496 26776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.522379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55278 (local address 127.21.114.126:37987)
0812 16:46:06.522419 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.522421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.522570 (+ 149us) server_negotiation.cc:407] Connection header received
0812 16:46:06.522647 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.522648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.522657 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.522738 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:06.522921 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.523496 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.524270 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.524515 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.524592 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.525245 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:06.525247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:06.525247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:06.525252 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:06.525265 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:06.525270 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:06.525321 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.525386 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.525408 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 16:46:06.527073 26696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 16:46:06.528707 26696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 16:46:06.535251 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.531278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:39931 (local address 127.0.0.1:42486)
0812 16:46:06.531721 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.531731 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.531782 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.532044 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.532045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.532047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:06.532092 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.532094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.532994 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.532995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.534303 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.534305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.534968 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.534969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.535044 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.535056 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.535130 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.535180 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":40,"thread_start_us":75,"threads_started":1}
I20260812 16:46:06.535265 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.531490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42486 (local address 127.21.114.66:39931)
0812 16:46:06.531643 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.531648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.531879 (+ 231us) server_negotiation.cc:407] Connection header received
0812 16:46:06.531929 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.531931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.531947 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.532045 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:06.532150 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.532907 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.534413 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.534879 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.534969 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.535063 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.535145 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.535182 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260812 16:46:06.535434 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.531138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:39353 (local address 127.0.0.1:54516)
0812 16:46:06.531422 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.531434 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.531486 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.531772 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.531773 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.531775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:06.531845 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.531847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.533188 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.533188 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.534303 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.534305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.535194 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.535194 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.535252 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.535255 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.535282 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.535309 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":8,"thread_start_us":124,"threads_started":1}
I20260812 16:46:06.535674 27532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.531177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33508 (local address 127.21.114.67:37809)
0812 16:46:06.531475 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.531480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.531491 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:06.531589 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.531592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.531610 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.531685 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:06.531929 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.533087 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.534227 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.534924 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.534995 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.535076 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.535478 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.535597 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":90,"threads_started":1}
I20260812 16:46:06.535831 27531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.531060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.67:37809 (local address 127.0.0.1:33508)
0812 16:46:06.531341 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.531385 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.531460 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.531760 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.531764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.531766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:06.531845 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.531848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.533220 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.533221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.534117 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.534120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.535118 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.535120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.535187 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.535193 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.535237 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.535293 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":8,"thread_start_us":77,"threads_started":1}
I20260812 16:46:06.535943 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.531261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54516 (local address 127.21.114.65:39353)
0812 16:46:06.531593 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.531597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.531606 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:06.531645 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.531647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.531661 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.531928 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:06.531985 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.533104 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.534394 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.535107 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.535624 (+ 517us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.535764 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.535791 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.535827 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":86,"threads_started":1}
I20260812 16:46:06.536031 27163 tablet_service.cc:1467] Processing CreateTablet for tablet 26b659f2d78b450abbd0270aeaa0ece0 (DEFAULT_TABLE table=test-table [id=d4cfc50d41094d8ba7dad0dbae196f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:06.536507 27163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b659f2d78b450abbd0270aeaa0ece0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:06.536583 26920 tablet_service.cc:1467] Processing CreateTablet for tablet 26b659f2d78b450abbd0270aeaa0ece0 (DEFAULT_TABLE table=test-table [id=d4cfc50d41094d8ba7dad0dbae196f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:06.536931 26920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b659f2d78b450abbd0270aeaa0ece0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:06.539255 27399 tablet_service.cc:1467] Processing CreateTablet for tablet 26b659f2d78b450abbd0270aeaa0ece0 (DEFAULT_TABLE table=test-table [id=d4cfc50d41094d8ba7dad0dbae196f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 16:46:06.539587 27399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b659f2d78b450abbd0270aeaa0ece0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:06.539919 27538 tablet_bootstrap.cc:492] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Bootstrap starting.
I20260812 16:46:06.540454 27542 tablet_bootstrap.cc:492] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12: Bootstrap starting.
I20260812 16:46:06.540658 27538 tablet_bootstrap.cc:654] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:06.541016 27538 log.cc:824] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:06.541200 27542 tablet_bootstrap.cc:654] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:06.541563 27542 log.cc:824] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:06.541893 27538 tablet_bootstrap.cc:492] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: No bootstrap required, opened a new log
I20260812 16:46:06.541973 27538 ts_tablet_manager.cc:1397] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:46:06.542430 27542 tablet_bootstrap.cc:492] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12: No bootstrap required, opened a new log
I20260812 16:46:06.542567 27542 ts_tablet_manager.cc:1397] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 16:46:06.543278 27546 tablet_bootstrap.cc:492] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Bootstrap starting.
I20260812 16:46:06.543928 27546 tablet_bootstrap.cc:654] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:06.544267 27546 log.cc:824] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:06.544267 27538 raft_consensus.cc:348] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.544487 27538 raft_consensus.cc:374] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:06.544560 27538 raft_consensus.cc:729] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 217499ed5d334148a09b2b74771cdd8a, State: Initialized, Role: FOLLOWER
I20260812 16:46:06.544689 27538 consensus_queue.cc:260] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.544981 27538 ts_tablet_manager.cc:1428] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:46:06.545070 27546 tablet_bootstrap.cc:492] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: No bootstrap required, opened a new log
I20260812 16:46:06.545136 27546 ts_tablet_manager.cc:1397] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 16:46:06.545133 27274 heartbeater.cc:503] Master 127.21.114.126:37987 was elected leader, sending a full tablet report...
I20260812 16:46:06.545565 27542 raft_consensus.cc:348] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.545780 27542 raft_consensus.cc:374] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:06.545825 27542 raft_consensus.cc:729] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9c825e231e34cadac5d212bc3374b12, State: Initialized, Role: FOLLOWER
I20260812 16:46:06.545948 27542 consensus_queue.cc:260] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.546227 27542 ts_tablet_manager.cc:1428] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 16:46:06.546347 27041 heartbeater.cc:503] Master 127.21.114.126:37987 was elected leader, sending a full tablet report...
I20260812 16:46:06.547667 27546 raft_consensus.cc:348] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.547791 27546 raft_consensus.cc:374] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:06.547813 27546 raft_consensus.cc:729] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66aedb7f3fca4aa49478955f27a57c56, State: Initialized, Role: FOLLOWER
I20260812 16:46:06.547886 27546 consensus_queue.cc:260] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.548062 27546 ts_tablet_manager.cc:1428] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 16:46:06.548187 27517 heartbeater.cc:503] Master 127.21.114.126:37987 was elected leader, sending a full tablet report...
I20260812 16:46:06.612479 27559 raft_consensus.cc:482] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 16:46:06.612677 27559 raft_consensus.cc:504] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.613157 27559 leader_election.cc:288] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 217499ed5d334148a09b2b74771cdd8a (127.21.114.66:39931), c9c825e231e34cadac5d212bc3374b12 (127.21.114.65:39353)
I20260812 16:46:06.616160 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.613586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:48181 (local address 127.21.114.66:39931)
0812 16:46:06.613658 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.613661 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.613670 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:06.613700 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.613701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.613714 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.613807 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:06.613986 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.614481 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.615449 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.615807 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.615895 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.615904 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.616052 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.616089 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 16:46:06.616160 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.613352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:39931 (local address 127.21.114.67:48181)
0812 16:46:06.613402 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.613417 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.613465 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.613829 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.613830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.613832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:06.613905 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.613907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.614588 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.614589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.615335 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.615337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.615897 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.615898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.615970 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.615973 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.616046 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.616089 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 16:46:06.616281 27561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.613548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:39353 (local address 127.21.114.67:44679)
0812 16:46:06.613689 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.613697 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:06.613753 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:06.613904 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:06.613905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:06.613907 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 16:46:06.613980 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.613982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.614664 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.614665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.615418 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:06.615420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.615974 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.615975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:06.616063 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.616066 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 16:46:06.616133 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 16:46:06.616169 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260812 16:46:06.616525 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.613486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.114.67:44679 (local address 127.21.114.65:39353)
0812 16:46:06.613541 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.613543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.613757 (+ 214us) server_negotiation.cc:407] Connection header received
0812 16:46:06.613810 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.613811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.613822 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.613901 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 16:46:06.614069 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.614571 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.615513 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.615878 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.615961 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.615969 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.616141 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.616178 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:46:06.616595 27195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26b659f2d78b450abbd0270aeaa0ece0" candidate_uuid: "66aedb7f3fca4aa49478955f27a57c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "217499ed5d334148a09b2b74771cdd8a" is_pre_election: true
I20260812 16:46:06.616765 27195 raft_consensus.cc:2454] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66aedb7f3fca4aa49478955f27a57c56 in term 0.
I20260812 16:46:06.616788 26962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26b659f2d78b450abbd0270aeaa0ece0" candidate_uuid: "66aedb7f3fca4aa49478955f27a57c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9c825e231e34cadac5d212bc3374b12" is_pre_election: true
I20260812 16:46:06.616989 26962 raft_consensus.cc:2454] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66aedb7f3fca4aa49478955f27a57c56 in term 0.
I20260812 16:46:06.617074 27304 leader_election.cc:302] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 217499ed5d334148a09b2b74771cdd8a, 66aedb7f3fca4aa49478955f27a57c56; no voters:
I20260812 16:46:06.617201 27559 raft_consensus.cc:2781] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 16:46:06.617259 27559 raft_consensus.cc:482] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 16:46:06.617280 27559 raft_consensus.cc:3037] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:06.617946 27559 raft_consensus.cc:504] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.618085 27559 leader_election.cc:288] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [CANDIDATE]: Term 1 election: Requested vote from peers 217499ed5d334148a09b2b74771cdd8a (127.21.114.66:39931), c9c825e231e34cadac5d212bc3374b12 (127.21.114.65:39353)
I20260812 16:46:06.618237 27195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26b659f2d78b450abbd0270aeaa0ece0" candidate_uuid: "66aedb7f3fca4aa49478955f27a57c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "217499ed5d334148a09b2b74771cdd8a"
I20260812 16:46:06.618253 26962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26b659f2d78b450abbd0270aeaa0ece0" candidate_uuid: "66aedb7f3fca4aa49478955f27a57c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9c825e231e34cadac5d212bc3374b12"
I20260812 16:46:06.618310 26962 raft_consensus.cc:3037] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:06.618331 27195 raft_consensus.cc:3037] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:06.619026 27195 raft_consensus.cc:2454] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66aedb7f3fca4aa49478955f27a57c56 in term 1.
I20260812 16:46:06.619033 26962 raft_consensus.cc:2454] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66aedb7f3fca4aa49478955f27a57c56 in term 1.
I20260812 16:46:06.619200 27304 leader_election.cc:302] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 217499ed5d334148a09b2b74771cdd8a, 66aedb7f3fca4aa49478955f27a57c56; no voters:
I20260812 16:46:06.619297 27559 raft_consensus.cc:2781] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:06.619437 27559 raft_consensus.cc:686] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 1 LEADER]: Becoming Leader. State: Replica: 66aedb7f3fca4aa49478955f27a57c56, State: Running, Role: LEADER
I20260812 16:46:06.619561 27559 consensus_queue.cc:237] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } }
I20260812 16:46:06.620474 26698 catalog_manager.cc:5495] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66aedb7f3fca4aa49478955f27a57c56 (127.21.114.67). New cstate: current_term: 1 leader_uuid: "66aedb7f3fca4aa49478955f27a57c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66aedb7f3fca4aa49478955f27a57c56" member_type: VOTER last_known_addr { host: "127.21.114.67" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 } health_report { overall_health: UNKNOWN } } }
W20260812 16:46:06.624008 27275 tablet.cc:2369] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 16:46:06.626323 27532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.624270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33510 (local address 127.21.114.67:37809)
0812 16:46:06.624341 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:06.624343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:06.624352 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:06.624435 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:06.624436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:06.624450 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:06.624510 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:06.624628 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.625049 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.625733 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:06.625900 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:06.625945 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:06.626076 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:06.626160 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:06.626214 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:06.626248 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 16:46:06.626264 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 16:46:06.627962 26962 raft_consensus.cc:1261] T 26b659f2d78b450abbd0270aeaa0ece0 P c9c825e231e34cadac5d212bc3374b12 [term 1 FOLLOWER]: Refusing update from remote peer 66aedb7f3fca4aa49478955f27a57c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:06.627969 27195 raft_consensus.cc:1261] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 1 FOLLOWER]: Refusing update from remote peer 66aedb7f3fca4aa49478955f27a57c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:06.628283 27562 consensus_queue.cc:1035] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9c825e231e34cadac5d212bc3374b12" member_type: VOTER last_known_addr { host: "127.21.114.65" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:06.628435 27559 consensus_queue.cc:1035] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "217499ed5d334148a09b2b74771cdd8a" member_type: VOTER last_known_addr { host: "127.21.114.66" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:06.630787 27569 mvcc.cc:205] Tried to move back new op lower bound from 7317721770505785344 to 7317721770474496000. Current Snapshot: MvccSnapshot[applied={T|T < 7317721770505785344}]
I20260812 16:46:06.631923 27573 mvcc.cc:205] Tried to move back new op lower bound from 7317721770505785344 to 7317721770474496000. Current Snapshot: MvccSnapshot[applied={T|T < 7317721770505785344 or (T in {7317721770505785344})}]
I20260812 16:46:06.633546 26698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:06.633643 26698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 16:46:06.634395 26698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ed4ceeaa1a942bf94952bd113bf9468: Sending DeleteTablet for 3 replicas of tablet 26b659f2d78b450abbd0270aeaa0ece0
I20260812 16:46:06.634722 26920 tablet_service.cc:1514] Processing DeleteTablet for tablet 26b659f2d78b450abbd0270aeaa0ece0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:06 UTC) from {username='slave'} at 127.0.0.1:54516
I20260812 16:46:06.634770 27163 tablet_service.cc:1514] Processing DeleteTablet for tablet 26b659f2d78b450abbd0270aeaa0ece0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:06 UTC) from {username='slave'} at 127.0.0.1:42486
I20260812 16:46:06.634768 27399 tablet_service.cc:1514] Processing DeleteTablet for tablet 26b659f2d78b450abbd0270aeaa0ece0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 16:46:06 UTC) from {username='slave'} at 127.0.0.1:33508
I20260812 16:46:06.635026 27594 tablet_replica.cc:330] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: stopping tablet replica
I20260812 16:46:06.635157 27593 tablet_replica.cc:330] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: stopping tablet replica
I20260812 16:46:06.635264 27593 raft_consensus.cc:2229] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 16:46:06.635262 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 26814
I20260812 16:46:06.635352 27593 raft_consensus.cc:2258] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:06.643651 27594 raft_consensus.cc:2229] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 1 LEADER]: Raft consensus shutting down.
I20260812 16:46:06.643965 27594 raft_consensus.cc:2258] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 16:46:06.644500 27594 ts_tablet_manager.cc:1905] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 16:46:06.646018 27594 ts_tablet_manager.cc:1918] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 16:46:06.646111 27594 log.cc:1196] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Deleting WAL directory at /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786552916613187-21961-0/minicluster-data/ts-2/wal/wals/26b659f2d78b450abbd0270aeaa0ece0
I20260812 16:46:06.646373 27594 ts_tablet_manager.cc:1939] T 26b659f2d78b450abbd0270aeaa0ece0 P 66aedb7f3fca4aa49478955f27a57c56: Deleting consensus metadata
I20260812 16:46:06.646844 26666 catalog_manager.cc:4841] TS 66aedb7f3fca4aa49478955f27a57c56 (127.21.114.67:37809): tablet 26b659f2d78b450abbd0270aeaa0ece0 (table test-table [id=d4cfc50d41094d8ba7dad0dbae196f9a]) successfully deleted
I20260812 16:46:06.648598 27593 ts_tablet_manager.cc:1905] T 26b659f2d78b450abbd0270aeaa0ece0 P 217499ed5d334148a09b2b74771cdd8a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 16:46:06.649264 26670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.114.65:39353 (error 108)
I20260812 16:46:06.649507 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27044
I20260812 16:46:06.653412 27531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.653243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.65:39353 (local address 127.0.0.1:54528)
0812 16:46:06.653297 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.653356 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.65:39353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 16:46:06.653556 26670 catalog_manager.cc:4584] TS c9c825e231e34cadac5d212bc3374b12 (127.21.114.65:39353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 26b659f2d78b450abbd0270aeaa0ece0: Network error: Client connection negotiation failed: client connection to 127.21.114.65:39353: connect: Connection refused (error 111)
I20260812 16:46:06.659792 27531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:06.659643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.66:39931 (local address 127.0.0.1:42500)
0812 16:46:06.659712 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:06.659747 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.66:39931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 16:46:06.659907 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27277
I20260812 16:46:06.684206 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 26635
2026-08-12T16:46:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (779 ms)
[----------] 6 tests from EncryptionPolicyTest (9616 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:06 dist-test-slave-45dx krb5kdc[27610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:06 dist-test-slave-45dx krb5kdc[27610](info): set up 2 sockets
Aug 12 16:46:06 dist-test-slave-45dx krb5kdc[27610](info): commencing operation
krb5kdc: starting...
W20260812 16:46:07.987128 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:08 dist-test-slave-45dx krb5kdc[27610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:08.112551 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41597
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:08.195815 27631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:08.196030 27631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:08.196053 27631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:08.197219 27631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:08.197265 27631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:08.197279 27631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:08.197292 27631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:08.197304 27631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:08.198688 27631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41597
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:08.198880 27631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:08.199048 27631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:08.203907 27639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:08.203931 27642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:08.203954 27640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:08.204108 27631 server_base.cc:1034] running on GCE node
I20260812 16:46:08.204399 27631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:08.204645 27631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:08.205787 27631 hybrid_clock.cc:648] HybridClock initialized: now 1786553168205775 us; error 33 us; skew 500 ppm
Aug 12 16:46:08 dist-test-slave-45dx krb5kdc[27610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553168, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:08.212945 27631 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:08.213440 27631 webserver.cc:460] Webserver started at http://127.0.0.1:38991/ using document root <none> and password file <none>
I20260812 16:46:08.213675 27631 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:08.213721 27631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:08.213901 27631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:08.215013 27631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "67e7186528cd475d8884fdd5a2090245"
format_stamp: "Formatted at 2026-08-12 16:46:08 on dist-test-slave-45dx"
server_key: "00a6fba675f1ba073c458db03cb1f329"
server_key_iv: "a778e9a2e4a59cc8489d49e3f99bacbf"
server_key_version: "encryptionkey@0"
I20260812 16:46:08.215394 27631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "67e7186528cd475d8884fdd5a2090245"
format_stamp: "Formatted at 2026-08-12 16:46:08 on dist-test-slave-45dx"
server_key: "00a6fba675f1ba073c458db03cb1f329"
server_key_iv: "a778e9a2e4a59cc8489d49e3f99bacbf"
server_key_version: "encryptionkey@0"
I20260812 16:46:08.216845 27631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:46:08.217636 27657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:08.217864 27631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:08.217949 27631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "67e7186528cd475d8884fdd5a2090245"
format_stamp: "Formatted at 2026-08-12 16:46:08 on dist-test-slave-45dx"
server_key: "00a6fba675f1ba073c458db03cb1f329"
server_key_iv: "a778e9a2e4a59cc8489d49e3f99bacbf"
server_key_version: "encryptionkey@0"
I20260812 16:46:08.218000 27631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:08.228125 27631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:08.229995 27631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:08.230101 27631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:08.234371 27631 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41597
I20260812 16:46:08.234406 27748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41597 every 8 connection(s)
I20260812 16:46:08.234748 27631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:08.235602 27749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:08.237941 27749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245: Bootstrap starting.
I20260812 16:46:08.238220 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27631
I20260812 16:46:08.238355 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:08.238546 21961 external_mini_cluster.cc:1428] Setting key 2a8cd18c5fdb902d166fa79a169bd903
I20260812 16:46:08.238719 27749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:08.239092 27749 log.cc:824] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:08.239794 27749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245: No bootstrap required, opened a new log
I20260812 16:46:08.242165 27749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67e7186528cd475d8884fdd5a2090245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41597 } }
I20260812 16:46:08.242337 27749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:08.242372 27749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67e7186528cd475d8884fdd5a2090245, State: Initialized, Role: FOLLOWER
I20260812 16:46:08.242506 27749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67e7186528cd475d8884fdd5a2090245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41597 } }
I20260812 16:46:08.242575 27749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:08.242602 27749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:08.242645 27749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:08.243237 27749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67e7186528cd475d8884fdd5a2090245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41597 } }
I20260812 16:46:08.243327 27749 leader_election.cc:302] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67e7186528cd475d8884fdd5a2090245; no voters:
I20260812 16:46:08.243521 27749 leader_election.cc:288] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:08.243556 27760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:08.243804 27760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [term 1 LEADER]: Becoming Leader. State: Replica: 67e7186528cd475d8884fdd5a2090245, State: Running, Role: LEADER
I20260812 16:46:08.243881 27749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:08.243914 27760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67e7186528cd475d8884fdd5a2090245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41597 } }
I20260812 16:46:08.244212 27760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67e7186528cd475d8884fdd5a2090245. Latest consensus state: current_term: 1 leader_uuid: "67e7186528cd475d8884fdd5a2090245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67e7186528cd475d8884fdd5a2090245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41597 } } }
I20260812 16:46:08.244329 27760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:08.244225 27765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67e7186528cd475d8884fdd5a2090245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67e7186528cd475d8884fdd5a2090245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41597 } } }
I20260812 16:46:08.244434 27765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:08.244585 27769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:08.245112 27769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 16:46:08 dist-test-slave-45dx krb5kdc[27610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 16:46:08.247155 27769 catalog_manager.cc:1347] Generated new cluster ID: bad9d18d752a4bc08fa68db946f717ce
I20260812 16:46:08.247254 27769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:08.250140 27755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:08.239122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39415 (local address 127.0.0.1:41597)
0812 16:46:08.239315 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:08.239325 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:08.239374 (+ 49us) server_negotiation.cc:407] Connection header received
0812 16:46:08.239909 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:08.239918 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:08.239985 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:08.240100 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:08.240913 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:08.241816 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:08.242891 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:08.243311 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:08.243445 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:08.246520 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:08.246524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:08.246524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:08.246533 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:08.248447 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:08.248891 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:08.248893 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:08.248894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:08.248993 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:08.249239 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:08.249240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:08.249240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:08.249526 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:08.249667 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:08.249827 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 16:46:08.249923 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260812 16:46:08.251174 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:08.256695 27769 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:08.257404 27769 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:08.259832 27755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:08.252618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50927 (local address 127.0.0.1:41597)
0812 16:46:08.252655 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:08.252657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:08.252799 (+ 142us) server_negotiation.cc:407] Connection header received
0812 16:46:08.252880 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:08.252881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:08.252889 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:08.252916 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:08.253525 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:08.254233 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:08.255212 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:08.255542 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:08.255578 (+ 36us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:08.257120 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:08.257121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:08.257121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:08.257128 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:08.258654 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:08.259048 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:08.259049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:08.259049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:08.259098 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:08.259299 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:08.259300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:08.259300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:08.259414 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:08.259482 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:08.259691 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 16:46:08.259748 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:46:08.262358 27769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67e7186528cd475d8884fdd5a2090245: Generated new TSK 0
I20260812 16:46:08.262538 27769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:08.266477 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27631
W20260812 16:46:08.286443 27602 connection.cc:535] client connection to 127.0.0.1:41597 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41597): Connection reset by peer (error 104)
2026-08-12T16:46:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1592 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:08 dist-test-slave-45dx krb5kdc[27800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:08 dist-test-slave-45dx krb5kdc[27800](info): set up 2 sockets
Aug 12 16:46:08 dist-test-slave-45dx krb5kdc[27800](info): commencing operation
krb5kdc: starting...
W20260812 16:46:09.593204 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:09 dist-test-slave-45dx krb5kdc[27800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:09.719632 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44371
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:09.803404 27822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:09.803653 27822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:09.803694 27822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:09.804875 27822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:09.804942 27822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:09.804965 27822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:09.804986 27822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:09.805016 27822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:09.806483 27822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44371
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:09.806769 27822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:09.807017 27822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:09.811826 27841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:09.811818 27832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:09.811834 27834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:09.812232 27822 server_base.cc:1034] running on GCE node
I20260812 16:46:09.812573 27822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:09.812867 27822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:09.814041 27822 hybrid_clock.cc:648] HybridClock initialized: now 1786553169814036 us; error 46 us; skew 500 ppm
Aug 12 16:46:09 dist-test-slave-45dx krb5kdc[27800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553169, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:09.816795 27822 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:09.817250 27822 webserver.cc:460] Webserver started at http://127.0.0.1:42205/ using document root <none> and password file <none>
I20260812 16:46:09.817492 27822 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:09.817559 27822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:09.817703 27822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:09.818759 27822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "a8b13b2dc20d444fa093c173a3af930f"
format_stamp: "Formatted at 2026-08-12 16:46:09 on dist-test-slave-45dx"
server_key: "f6eab4fc7f307fb03213f9189a108bc4"
server_key_iv: "52fb430c211965cb17565aa9807c0d2e"
server_key_version: "encryptionkey@0"
I20260812 16:46:09.819128 27822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "a8b13b2dc20d444fa093c173a3af930f"
format_stamp: "Formatted at 2026-08-12 16:46:09 on dist-test-slave-45dx"
server_key: "f6eab4fc7f307fb03213f9189a108bc4"
server_key_iv: "52fb430c211965cb17565aa9807c0d2e"
server_key_version: "encryptionkey@0"
I20260812 16:46:09.820511 27822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:46:09.821260 27850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:09.821637 27822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:09.821766 27822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "a8b13b2dc20d444fa093c173a3af930f"
format_stamp: "Formatted at 2026-08-12 16:46:09 on dist-test-slave-45dx"
server_key: "f6eab4fc7f307fb03213f9189a108bc4"
server_key_iv: "52fb430c211965cb17565aa9807c0d2e"
server_key_version: "encryptionkey@0"
I20260812 16:46:09.821826 27822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:09.833879 27822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:09.836455 27822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:09.836578 27822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:09.840606 27822 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44371
I20260812 16:46:09.840672 27960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44371 every 8 connection(s)
I20260812 16:46:09.841032 27822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:09.841974 27961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:09.844274 27961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f: Bootstrap starting.
I20260812 16:46:09.844738 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 27822
I20260812 16:46:09.844856 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:09.845021 27961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:09.845057 21961 external_mini_cluster.cc:1428] Setting key dcc09ed6551a559a1839d332b03aa1ee
I20260812 16:46:09.845327 27961 log.cc:824] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:09.846094 27961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f: No bootstrap required, opened a new log
I20260812 16:46:09.847926 27961 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b13b2dc20d444fa093c173a3af930f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260812 16:46:09.848088 27961 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:09.848138 27961 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b13b2dc20d444fa093c173a3af930f, State: Initialized, Role: FOLLOWER
I20260812 16:46:09.848276 27961 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b13b2dc20d444fa093c173a3af930f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260812 16:46:09.848405 27961 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:09.848451 27961 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:09.848501 27961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:09.849061 27961 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b13b2dc20d444fa093c173a3af930f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260812 16:46:09.849185 27961 leader_election.cc:302] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8b13b2dc20d444fa093c173a3af930f; no voters:
I20260812 16:46:09.849387 27961 leader_election.cc:288] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:09.849454 27974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:09.849673 27974 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [term 1 LEADER]: Becoming Leader. State: Replica: a8b13b2dc20d444fa093c173a3af930f, State: Running, Role: LEADER
I20260812 16:46:09.849692 27961 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:09.849848 27974 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b13b2dc20d444fa093c173a3af930f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } }
I20260812 16:46:09.850250 27974 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8b13b2dc20d444fa093c173a3af930f. Latest consensus state: current_term: 1 leader_uuid: "a8b13b2dc20d444fa093c173a3af930f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b13b2dc20d444fa093c173a3af930f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } } }
I20260812 16:46:09.850257 27975 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8b13b2dc20d444fa093c173a3af930f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b13b2dc20d444fa093c173a3af930f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44371 } } }
I20260812 16:46:09.850396 27974 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:09.850407 27975 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:09.850783 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:09.845542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54427 (local address 127.0.0.1:44371)
0812 16:46:09.845758 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:09.845767 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:09.845793 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:46:09.846276 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:09.846283 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:09.846332 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:09.846478 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:09.846700 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:09.847589 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:09.848517 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:09.848979 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:09.849103 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:09.849905 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:09.849910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:09.849910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:09.850117 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:09.850161 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:09.850176 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:09.850506 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:09.850556 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 16:46:09.850586 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":97,"threads_started":1}
I20260812 16:46:09.851293 27983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:09.851652 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:09.852548 27983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:09.855423 27983 catalog_manager.cc:1347] Generated new cluster ID: a1fc058e8c2f4024a3922274627ab1aa
I20260812 16:46:09.855481 27983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:09.856428 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:09.853163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60813 (local address 127.0.0.1:44371)
0812 16:46:09.853202 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:09.853204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:09.853314 (+ 110us) server_negotiation.cc:407] Connection header received
0812 16:46:09.853375 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:09.853375 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:09.853386 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:09.853449 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:09.853570 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:09.854056 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:09.855075 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:09.855270 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:09.855355 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:09.856155 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:09.856156 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:09.856157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:09.856161 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:09.856176 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:09.856180 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:09.856234 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:09.856295 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 16:46:09.856333 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:46:09.869015 27983 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:09.869735 27983 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:09.884497 27983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8b13b2dc20d444fa093c173a3af930f: Generated new TSK 0
I20260812 16:46:09.884749 27983 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:09.887282 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 27822
W20260812 16:46:09.911172 27798 connection.cc:535] client connection to 127.0.0.1:44371 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44371): Connection reset by peer (error 104)
2026-08-12T16:46:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1622 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:09 dist-test-slave-45dx krb5kdc[28026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:09 dist-test-slave-45dx krb5kdc[28026](info): set up 2 sockets
Aug 12 16:46:09 dist-test-slave-45dx krb5kdc[28026](info): commencing operation
krb5kdc: starting...
W20260812 16:46:11.221560 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:11 dist-test-slave-45dx krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:11.346688 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44989
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:11.430516 28045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:11.430716 28045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:11.430737 28045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:11.431874 28045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:11.431917 28045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:11.431932 28045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:11.431945 28045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:11.431957 28045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:11.433513 28045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44989
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:11.433743 28045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:11.433979 28045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:11.438802 28053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:11.438819 28062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:11.438822 28054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:11.439160 28045 server_base.cc:1034] running on GCE node
I20260812 16:46:11.439472 28045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:11.439765 28045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:11.440927 28045 hybrid_clock.cc:648] HybridClock initialized: now 1786553171440912 us; error 63 us; skew 500 ppm
Aug 12 16:46:11 dist-test-slave-45dx krb5kdc[28026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553171, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:11.443418 28045 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:11.443902 28045 webserver.cc:460] Webserver started at http://127.0.0.1:40101/ using document root <none> and password file <none>
I20260812 16:46:11.444126 28045 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:11.444193 28045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:11.444370 28045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:11.445417 28045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "b77d594e00da4a969e58b2ef52e0f9b3"
format_stamp: "Formatted at 2026-08-12 16:46:11 on dist-test-slave-45dx"
server_key: "97afc255c09c12af5a7f4ba285289869"
server_key_iv: "dd65c088d63c993a90841574728cbeea"
server_key_version: "encryptionkey@0"
I20260812 16:46:11.445801 28045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "b77d594e00da4a969e58b2ef52e0f9b3"
format_stamp: "Formatted at 2026-08-12 16:46:11 on dist-test-slave-45dx"
server_key: "97afc255c09c12af5a7f4ba285289869"
server_key_iv: "dd65c088d63c993a90841574728cbeea"
server_key_version: "encryptionkey@0"
I20260812 16:46:11.447176 28045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:11.447882 28078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:11.448062 28045 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:11.448172 28045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "b77d594e00da4a969e58b2ef52e0f9b3"
format_stamp: "Formatted at 2026-08-12 16:46:11 on dist-test-slave-45dx"
server_key: "97afc255c09c12af5a7f4ba285289869"
server_key_iv: "dd65c088d63c993a90841574728cbeea"
server_key_version: "encryptionkey@0"
I20260812 16:46:11.448247 28045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:11.451666 28045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:11.453603 28045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:11.453761 28045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:11.458065 28045 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44989
I20260812 16:46:11.458097 28172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44989 every 8 connection(s)
I20260812 16:46:11.458423 28045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:11.459416 28173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:11.462054 28173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3: Bootstrap starting.
I20260812 16:46:11.462203 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28045
I20260812 16:46:11.462333 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:11.462546 21961 external_mini_cluster.cc:1428] Setting key bd85e87feab6388570556188af02b243
I20260812 16:46:11.462810 28173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:11.463214 28173 log.cc:824] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:11.463966 28173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3: No bootstrap required, opened a new log
I20260812 16:46:11.465235 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:11.463008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42847 (local address 127.0.0.1:44989)
0812 16:46:11.463221 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:11.463230 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:11.463263 (+ 33us) server_negotiation.cc:407] Connection header received
0812 16:46:11.463860 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:11.463868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:11.463897 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:11.464061 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:11.464785 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:11.464789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:11.464790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:11.464794 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:11.464846 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:11.464857 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:11.464966 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:11.465000 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 16:46:11.465042 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":83,"threads_started":1}
I20260812 16:46:11.466240 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:11.466318 28173 raft_consensus.cc:348] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44989 } }
I20260812 16:46:11.466478 28173 raft_consensus.cc:374] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:11.466508 28173 raft_consensus.cc:729] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77d594e00da4a969e58b2ef52e0f9b3, State: Initialized, Role: FOLLOWER
I20260812 16:46:11.466619 28173 consensus_queue.cc:260] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44989 } }
I20260812 16:46:11.466703 28173 raft_consensus.cc:388] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:11.466749 28173 raft_consensus.cc:482] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:11.466800 28173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:11.467610 28173 raft_consensus.cc:504] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44989 } }
I20260812 16:46:11.467720 28173 leader_election.cc:302] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b77d594e00da4a969e58b2ef52e0f9b3; no voters:
I20260812 16:46:11.467939 28173 leader_election.cc:288] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:11.467991 28193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:11.468163 28193 raft_consensus.cc:686] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [term 1 LEADER]: Becoming Leader. State: Replica: b77d594e00da4a969e58b2ef52e0f9b3, State: Running, Role: LEADER
I20260812 16:46:11.468240 28173 sys_catalog.cc:564] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:11.468329 28193 consensus_queue.cc:237] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44989 } }
I20260812 16:46:11.468698 28196 sys_catalog.cc:455] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b77d594e00da4a969e58b2ef52e0f9b3. Latest consensus state: current_term: 1 leader_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44989 } } }
I20260812 16:46:11.468699 28194 sys_catalog.cc:455] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b77d594e00da4a969e58b2ef52e0f9b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44989 } } }
I20260812 16:46:11.468914 28194 sys_catalog.cc:458] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:11.468845 28196 sys_catalog.cc:458] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:11.469379 28204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:11.469985 28204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:11.470815 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:11.467838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48125 (local address 127.0.0.1:44989)
0812 16:46:11.467880 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:11.467882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:11.469766 (+ 1884us) server_negotiation.cc:407] Connection header received
0812 16:46:11.469903 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:11.469904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:11.469909 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:11.469975 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:11.470587 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:11.470588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:11.470589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:11.470594 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:11.470609 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:11.470613 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:11.470675 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:11.470743 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 16:46:11.470756 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:11.472162 28204 catalog_manager.cc:1347] Generated new cluster ID: 1b88bfb5909843c493f1f333a51ecf25
I20260812 16:46:11.472214 28204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:11.485486 28204 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:11.485663 28204 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:11.494618 28204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b77d594e00da4a969e58b2ef52e0f9b3: Generated new TSK 0
I20260812 16:46:11.494819 28204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:11.501204 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28045
2026-08-12T16:46:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:11 dist-test-slave-45dx krb5kdc[28227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:11 dist-test-slave-45dx krb5kdc[28227](info): set up 2 sockets
Aug 12 16:46:11 dist-test-slave-45dx krb5kdc[28227](info): commencing operation
krb5kdc: starting...
W20260812 16:46:12.803543 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:12 dist-test-slave-45dx krb5kdc[28227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:12.929204 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44967
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:13.013502 28249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:13.013711 28249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:13.013733 28249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:13.014976 28249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:13.015021 28249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:13.015035 28249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:13.015048 28249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:13.015084 28249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:13.016556 28249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:13.016817 28249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:13.017077 28249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:13.022138 28262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:13.022137 28256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:13.022244 28249 server_base.cc:1034] running on GCE node
W20260812 16:46:13.022168 28259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:13.022676 28249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:13.022989 28249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:13.024164 28249 hybrid_clock.cc:648] HybridClock initialized: now 1786553173024140 us; error 37 us; skew 500 ppm
Aug 12 16:46:13 dist-test-slave-45dx krb5kdc[28227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553173, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:13.026795 28249 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:13.027237 28249 webserver.cc:460] Webserver started at http://127.0.0.1:34463/ using document root <none> and password file <none>
I20260812 16:46:13.027419 28249 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:13.027460 28249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:13.027550 28249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:13.028620 28249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2"
format_stamp: "Formatted at 2026-08-12 16:46:13 on dist-test-slave-45dx"
server_key: "f3acb91a21a85c589d4369429ad00c45"
server_key_iv: "3d7dd87f47a436e5944470528bb988c8"
server_key_version: "encryptionkey@0"
I20260812 16:46:13.028932 28249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2"
format_stamp: "Formatted at 2026-08-12 16:46:13 on dist-test-slave-45dx"
server_key: "f3acb91a21a85c589d4369429ad00c45"
server_key_iv: "3d7dd87f47a436e5944470528bb988c8"
server_key_version: "encryptionkey@0"
I20260812 16:46:13.030197 28249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:13.030889 28276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:13.031087 28249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:13.031174 28249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2"
format_stamp: "Formatted at 2026-08-12 16:46:13 on dist-test-slave-45dx"
server_key: "f3acb91a21a85c589d4369429ad00c45"
server_key_iv: "3d7dd87f47a436e5944470528bb988c8"
server_key_version: "encryptionkey@0"
I20260812 16:46:13.031230 28249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:13.043953 28249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:13.045965 28249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:13.046078 28249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:13.050125 28249 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44967
I20260812 16:46:13.050196 28372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44967 every 8 connection(s)
I20260812 16:46:13.050555 28249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:13.051462 28373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:13.053905 28373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2: Bootstrap starting.
I20260812 16:46:13.054502 28373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:13.054798 28373 log.cc:824] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:13.054800 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28249
I20260812 16:46:13.054932 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:13.055140 21961 external_mini_cluster.cc:1428] Setting key d98693300b827672b7694368b0fa266f
I20260812 16:46:13.055660 28373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2: No bootstrap required, opened a new log
I20260812 16:46:13.057976 28373 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44967 } }
I20260812 16:46:13.058113 28373 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:13.058136 28373 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdcbb5666e4d46259c6f22f47c0b0dc2, State: Initialized, Role: FOLLOWER
I20260812 16:46:13.058270 28373 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44967 } }
I20260812 16:46:13.058333 28373 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:13.058354 28373 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:13.058409 28373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:13.058979 28373 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44967 } }
I20260812 16:46:13.059067 28373 leader_election.cc:302] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdcbb5666e4d46259c6f22f47c0b0dc2; no voters:
I20260812 16:46:13.059299 28373 leader_election.cc:288] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:13.059319 28382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:13.059446 28382 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [term 1 LEADER]: Becoming Leader. State: Replica: bdcbb5666e4d46259c6f22f47c0b0dc2, State: Running, Role: LEADER
I20260812 16:46:13.059580 28373 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:13.059613 28382 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44967 } }
I20260812 16:46:13.060021 28385 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdcbb5666e4d46259c6f22f47c0b0dc2. Latest consensus state: current_term: 1 leader_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44967 } } }
I20260812 16:46:13.060117 28385 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:13.060356 28383 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcbb5666e4d46259c6f22f47c0b0dc2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44967 } } }
I20260812 16:46:13.060637 28383 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:13.060889 28395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:13.061473 28395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 16:46:13 dist-test-slave-45dx krb5kdc[28227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 16:46:13.063961 28395 catalog_manager.cc:1347] Generated new cluster ID: ceda52870ad54d3ea98d86538ef48328
I20260812 16:46:13.064013 28395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:13.067488 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:13.055652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36517 (local address 127.0.0.1:44967)
0812 16:46:13.055827 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:13.055836 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:13.055876 (+ 40us) server_negotiation.cc:407] Connection header received
0812 16:46:13.056937 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:13.056944 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:13.057004 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:13.057119 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:13.057941 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:13.059415 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:13.060512 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:13.061179 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:13.061323 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:13.064071 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:13.064076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:13.064077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:13.064091 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:13.065929 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:13.066323 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:13.066332 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:13.066333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:13.066422 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:13.066647 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:13.066648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:13.066648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:13.066887 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:13.067067 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:13.067149 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 16:46:13.067287 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260812 16:46:13.068634 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:13.072181 28395 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:13.072904 28395 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:13.085042 28395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdcbb5666e4d46259c6f22f47c0b0dc2: Generated new TSK 0
I20260812 16:46:13.085289 28395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:13.090197 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:13.070011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54867 (local address 127.0.0.1:44967)
0812 16:46:13.070047 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:13.070049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:13.071902 (+ 1853us) server_negotiation.cc:407] Connection header received
0812 16:46:13.071954 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:13.071955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:13.071966 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:13.072032 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:13.076884 (+ 4852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:13.077542 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:13.078692 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:13.085904 (+ 7212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:13.085989 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:13.087566 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:13.087568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:13.087568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:13.087575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:13.089084 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:13.089481 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:13.089482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:13.089482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:13.089533 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:13.089739 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:13.089740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:13.089740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:13.089839 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:13.089929 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:13.090067 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 16:46:13.090136 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:46:13.092572 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28249
2026-08-12T16:46:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1595 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:13 dist-test-slave-45dx krb5kdc[28427](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:13 dist-test-slave-45dx krb5kdc[28427](info): set up 2 sockets
Aug 12 16:46:13 dist-test-slave-45dx krb5kdc[28427](info): commencing operation
krb5kdc: starting...
W20260812 16:46:14.425176 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:14 dist-test-slave-45dx krb5kdc[28427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:14.559796 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42615
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:14.644505 28446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:14.644711 28446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:14.644734 28446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:14.645913 28446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:14.645960 28446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:14.645975 28446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:14.645987 28446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:14.646041 28446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:14.647512 28446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:14.647774 28446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:14.648015 28446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:14.652951 28458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:14.652979 28460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:14.652993 28457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:14.653028 28446 server_base.cc:1034] running on GCE node
I20260812 16:46:14.653363 28446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:14.653726 28446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:14.654906 28446 hybrid_clock.cc:648] HybridClock initialized: now 1786553174654887 us; error 48 us; skew 500 ppm
Aug 12 16:46:14 dist-test-slave-45dx krb5kdc[28427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553174, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:14.663241 28446 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:14.663740 28446 webserver.cc:460] Webserver started at http://127.0.0.1:32987/ using document root <none> and password file <none>
I20260812 16:46:14.663968 28446 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:14.664013 28446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:14.664108 28446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:14.665269 28446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "15bb70e23d4a487db3b67f03440e5970"
format_stamp: "Formatted at 2026-08-12 16:46:14 on dist-test-slave-45dx"
server_key: "0a7136c0f5165b47a3c0a5ab05ccf8f4"
server_key_iv: "b9b6b3418f92b3c327a7dfb3527ff0a0"
server_key_version: "encryptionkey@0"
I20260812 16:46:14.665594 28446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "15bb70e23d4a487db3b67f03440e5970"
format_stamp: "Formatted at 2026-08-12 16:46:14 on dist-test-slave-45dx"
server_key: "0a7136c0f5165b47a3c0a5ab05ccf8f4"
server_key_iv: "b9b6b3418f92b3c327a7dfb3527ff0a0"
server_key_version: "encryptionkey@0"
I20260812 16:46:14.666949 28446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:14.667668 28470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:14.667869 28446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:14.667971 28446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "15bb70e23d4a487db3b67f03440e5970"
format_stamp: "Formatted at 2026-08-12 16:46:14 on dist-test-slave-45dx"
server_key: "0a7136c0f5165b47a3c0a5ab05ccf8f4"
server_key_iv: "b9b6b3418f92b3c327a7dfb3527ff0a0"
server_key_version: "encryptionkey@0"
I20260812 16:46:14.668030 28446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:14.687903 28446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:14.689996 28446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:14.690115 28446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:14.694155 28446 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42615
I20260812 16:46:14.694219 28571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42615 every 8 connection(s)
I20260812 16:46:14.694579 28446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:14.695509 28572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:14.695739 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28446
I20260812 16:46:14.695878 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:14.696107 21961 external_mini_cluster.cc:1428] Setting key 205b1ceadf3c716d89ea8f812fe6d2de
I20260812 16:46:14.699295 28572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970: Bootstrap starting.
I20260812 16:46:14.699939 28572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:14.700253 28572 log.cc:824] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:14.701067 28572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970: No bootstrap required, opened a new log
I20260812 16:46:14.702081 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:14.696667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53079 (local address 127.0.0.1:42615)
0812 16:46:14.696881 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:14.696891 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:14.696928 (+ 37us) server_negotiation.cc:407] Connection header received
0812 16:46:14.697415 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:14.697425 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:14.697493 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:14.697652 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:14.697857 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:14.699233 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:14.700057 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:14.700558 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:14.700682 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:14.701424 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:14.701428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:14.701428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:14.701592 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:14.701624 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:14.701634 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:14.701707 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:14.701834 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 16:46:14.701904 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260812 16:46:14.702876 28572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15bb70e23d4a487db3b67f03440e5970" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260812 16:46:14.703064 28572 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:14.703104 28572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15bb70e23d4a487db3b67f03440e5970, State: Initialized, Role: FOLLOWER
I20260812 16:46:14.703226 28572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15bb70e23d4a487db3b67f03440e5970" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260812 16:46:14.703317 28572 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:14.703359 28572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:14.703418 28572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:14.703511 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:14.704026 28572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15bb70e23d4a487db3b67f03440e5970" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260812 16:46:14.704155 28572 leader_election.cc:302] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15bb70e23d4a487db3b67f03440e5970; no voters:
I20260812 16:46:14.704376 28572 leader_election.cc:288] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:14.704401 28581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:14.704562 28581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [term 1 LEADER]: Becoming Leader. State: Replica: 15bb70e23d4a487db3b67f03440e5970, State: Running, Role: LEADER
I20260812 16:46:14.704685 28572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:14.704715 28581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15bb70e23d4a487db3b67f03440e5970" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260812 16:46:14.705096 28581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15bb70e23d4a487db3b67f03440e5970" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15bb70e23d4a487db3b67f03440e5970" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } } }
I20260812 16:46:14.705247 28581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:14.705438 28581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15bb70e23d4a487db3b67f03440e5970. Latest consensus state: current_term: 1 leader_uuid: "15bb70e23d4a487db3b67f03440e5970" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15bb70e23d4a487db3b67f03440e5970" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } } }
I20260812 16:46:14.705559 28581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:14.705958 28607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:14.706542 28607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:14.708225 28607 catalog_manager.cc:1347] Generated new cluster ID: dac7ea65b3874e6fb44948f463c99f01
I20260812 16:46:14.708297 28607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:14.708714 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:14.704970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38009 (local address 127.0.0.1:42615)
0812 16:46:14.705005 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:14.705008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:14.705192 (+ 184us) server_negotiation.cc:407] Connection header received
0812 16:46:14.705287 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:14.705288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:14.705300 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:14.705330 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:14.705560 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:14.706296 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:14.707266 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:14.707543 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:14.707612 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:14.708395 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:14.708396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:14.708396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:14.708401 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:14.708417 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:14.708422 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:14.708476 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:14.708598 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 16:46:14.708623 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 16:46:14.721271 28607 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:14.722062 28607 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:14.731449 28607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15bb70e23d4a487db3b67f03440e5970: Generated new TSK 0
I20260812 16:46:14.731695 28607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:14.737731 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28446
2026-08-12T16:46:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1648 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:14 dist-test-slave-45dx krb5kdc[28632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:14 dist-test-slave-45dx krb5kdc[28632](info): set up 2 sockets
Aug 12 16:46:14 dist-test-slave-45dx krb5kdc[28632](info): commencing operation
krb5kdc: starting...
W20260812 16:46:16.050312 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:16 dist-test-slave-45dx krb5kdc[28632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:16.179831 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40897
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:16.267036 28651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:16.267357 28651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:16.267413 28651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:16.269120 28651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:16.269197 28651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:16.269222 28651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:16.269243 28651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:16.269273 28651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:16.272039 28651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:16.272379 28651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:16.272688 28651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:16.279079 28660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:16.279160 28666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:16.279090 28659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:16.279511 28651 server_base.cc:1034] running on GCE node
I20260812 16:46:16.279873 28651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:16.280206 28651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:16.281386 28651 hybrid_clock.cc:648] HybridClock initialized: now 1786553176281382 us; error 46 us; skew 500 ppm
Aug 12 16:46:16 dist-test-slave-45dx krb5kdc[28632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553176, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:16.283968 28651 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:16.284511 28651 webserver.cc:460] Webserver started at http://127.0.0.1:40963/ using document root <none> and password file <none>
I20260812 16:46:16.284701 28651 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:16.284741 28651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:16.284833 28651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:16.285900 28651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5"
format_stamp: "Formatted at 2026-08-12 16:46:16 on dist-test-slave-45dx"
server_key: "e489613a61e55ad363d4a30b10738064"
server_key_iv: "e00617970ca097153b752652ad411128"
server_key_version: "encryptionkey@0"
I20260812 16:46:16.286207 28651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5"
format_stamp: "Formatted at 2026-08-12 16:46:16 on dist-test-slave-45dx"
server_key: "e489613a61e55ad363d4a30b10738064"
server_key_iv: "e00617970ca097153b752652ad411128"
server_key_version: "encryptionkey@0"
I20260812 16:46:16.287477 28651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:16.288285 28679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:16.288537 28651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:16.288614 28651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5"
format_stamp: "Formatted at 2026-08-12 16:46:16 on dist-test-slave-45dx"
server_key: "e489613a61e55ad363d4a30b10738064"
server_key_iv: "e00617970ca097153b752652ad411128"
server_key_version: "encryptionkey@0"
I20260812 16:46:16.288668 28651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:16.291908 28651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:16.293915 28651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:16.294024 28651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:16.298098 28651 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40897
I20260812 16:46:16.298152 28784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40897 every 8 connection(s)
I20260812 16:46:16.298482 28651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:16.299472 28785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:16.301877 28785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5: Bootstrap starting.
I20260812 16:46:16.302467 28785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:16.302767 28785 log.cc:824] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:16.303479 28785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5: No bootstrap required, opened a new log
I20260812 16:46:16.305433 28785 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40897 } }
I20260812 16:46:16.305616 28785 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:16.305665 28785 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7ffbedc5200429bb1b22cbd6f5d75b5, State: Initialized, Role: FOLLOWER
I20260812 16:46:16.305845 28785 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40897 } }
I20260812 16:46:16.305934 28785 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:16.305976 28785 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:16.306030 28785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:16.306592 28785 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40897 } }
I20260812 16:46:16.306718 28785 leader_election.cc:302] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7ffbedc5200429bb1b22cbd6f5d75b5; no voters:
I20260812 16:46:16.306942 28785 leader_election.cc:288] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:16.306977 28789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:16.307147 28789 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [term 1 LEADER]: Becoming Leader. State: Replica: f7ffbedc5200429bb1b22cbd6f5d75b5, State: Running, Role: LEADER
I20260812 16:46:16.307216 28785 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:16.307237 28789 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40897 } }
I20260812 16:46:16.307472 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28651
I20260812 16:46:16.307585 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:16.307703 28791 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7ffbedc5200429bb1b22cbd6f5d75b5. Latest consensus state: current_term: 1 leader_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40897 } } }
I20260812 16:46:16.307793 28791 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:16.307833 21961 external_mini_cluster.cc:1428] Setting key cea34b104bcf70f949fe89213a59aa4e
I20260812 16:46:16.307974 28790 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbedc5200429bb1b22cbd6f5d75b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40897 } } }
I20260812 16:46:16.308117 28790 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:16.308205 28794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:16.308808 28794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:16.310693 28802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:16.308481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48489 (local address 127.0.0.1:40897)
0812 16:46:16.308685 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:16.308693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:16.308720 (+ 27us) server_negotiation.cc:407] Connection header received
0812 16:46:16.308827 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:16.308832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:16.308878 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:16.309030 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:16.309998 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:16.310001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:16.310002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:16.310006 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:16.310046 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:16.310060 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:16.310120 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:16.310243 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 16:46:16.310283 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
I20260812 16:46:16.310869 28794 catalog_manager.cc:1347] Generated new cluster ID: 867e7bab861747c2a659c7c17b832fc4
I20260812 16:46:16.310920 28794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:16.311738 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:16.317816 28802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:16.316670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45761 (local address 127.0.0.1:40897)
0812 16:46:16.316708 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:16.316710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:16.316875 (+ 165us) server_negotiation.cc:407] Connection header received
0812 16:46:16.316929 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:16.316930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:16.316936 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:16.316983 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:16.317566 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:16.317568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:16.317568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:16.317571 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:16.317588 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:16.317592 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:16.317648 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:16.317720 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 16:46:16.317732 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:16.331451 28794 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:16.331653 28794 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:16.334180 28794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7ffbedc5200429bb1b22cbd6f5d75b5: Generated new TSK 0
I20260812 16:46:16.334370 28794 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:16.340433 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28651
2026-08-12T16:46:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:16 dist-test-slave-45dx krb5kdc[28841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:16 dist-test-slave-45dx krb5kdc[28841](info): set up 2 sockets
Aug 12 16:46:16 dist-test-slave-45dx krb5kdc[28841](info): commencing operation
krb5kdc: starting...
W20260812 16:46:17.657423 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:17 dist-test-slave-45dx krb5kdc[28841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:17.787552 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:17.871577 28875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:17.871793 28875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:17.871816 28875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:17.872937 28875 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:17.872977 28875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:17.872991 28875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:17.873003 28875 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:17.873016 28875 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:17.874437 28875 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:17.874635 28875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:17.874809 28875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:17.879894 28894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:17.879894 28891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:17.879894 28888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:17.880254 28875 server_base.cc:1034] running on GCE node
I20260812 16:46:17.880561 28875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:17.880808 28875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:17.881953 28875 hybrid_clock.cc:648] HybridClock initialized: now 1786553177881927 us; error 35 us; skew 500 ppm
Aug 12 16:46:17 dist-test-slave-45dx krb5kdc[28841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553177, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:17.884501 28875 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:17.884984 28875 webserver.cc:460] Webserver started at http://127.0.0.1:45253/ using document root <none> and password file <none>
I20260812 16:46:17.885197 28875 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:17.885239 28875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:17.885329 28875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:17.886350 28875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "11045a7f2937421ab64640d5bfbf82de"
format_stamp: "Formatted at 2026-08-12 16:46:17 on dist-test-slave-45dx"
server_key: "ad5411dac4240716926ec2b6fbe6ef55"
server_key_iv: "a080382c1b72f82084d6a31c0b547673"
server_key_version: "encryptionkey@0"
I20260812 16:46:17.886659 28875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "11045a7f2937421ab64640d5bfbf82de"
format_stamp: "Formatted at 2026-08-12 16:46:17 on dist-test-slave-45dx"
server_key: "ad5411dac4240716926ec2b6fbe6ef55"
server_key_iv: "a080382c1b72f82084d6a31c0b547673"
server_key_version: "encryptionkey@0"
I20260812 16:46:17.887967 28875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:46:17.888736 28905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:17.888936 28875 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 16:46:17.889005 28875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "11045a7f2937421ab64640d5bfbf82de"
format_stamp: "Formatted at 2026-08-12 16:46:17 on dist-test-slave-45dx"
server_key: "ad5411dac4240716926ec2b6fbe6ef55"
server_key_iv: "a080382c1b72f82084d6a31c0b547673"
server_key_version: "encryptionkey@0"
I20260812 16:46:17.889097 28875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:17.901808 28875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:17.903834 28875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:17.904008 28875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:17.908368 28875 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45789
I20260812 16:46:17.908427 29008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45789 every 8 connection(s)
I20260812 16:46:17.908810 28875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:17.909723 29010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:17.912190 29010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de: Bootstrap starting.
I20260812 16:46:17.912830 29010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:17.913138 29010 log.cc:824] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:17.913156 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 28875
I20260812 16:46:17.913288 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:17.913520 21961 external_mini_cluster.cc:1428] Setting key 877e3bf0ee0e2d3cb844e89cd1ccc57f
I20260812 16:46:17.913902 29010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de: No bootstrap required, opened a new log
I20260812 16:46:17.915771 29010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11045a7f2937421ab64640d5bfbf82de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45789 } }
I20260812 16:46:17.915922 29010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:17.915947 29010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11045a7f2937421ab64640d5bfbf82de, State: Initialized, Role: FOLLOWER
I20260812 16:46:17.916153 29010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11045a7f2937421ab64640d5bfbf82de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45789 } }
I20260812 16:46:17.916255 29010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:17.916291 29010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:17.916375 29010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:17.917140 29010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11045a7f2937421ab64640d5bfbf82de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45789 } }
I20260812 16:46:17.917249 29010 leader_election.cc:302] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11045a7f2937421ab64640d5bfbf82de; no voters:
I20260812 16:46:17.917403 29010 leader_election.cc:288] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:17.917433 29020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:17.917616 29020 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [term 1 LEADER]: Becoming Leader. State: Replica: 11045a7f2937421ab64640d5bfbf82de, State: Running, Role: LEADER
I20260812 16:46:17.917642 29010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:17.917779 29020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11045a7f2937421ab64640d5bfbf82de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45789 } }
I20260812 16:46:17.918191 29021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11045a7f2937421ab64640d5bfbf82de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11045a7f2937421ab64640d5bfbf82de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45789 } } }
I20260812 16:46:17.918207 29024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11045a7f2937421ab64640d5bfbf82de. Latest consensus state: current_term: 1 leader_uuid: "11045a7f2937421ab64640d5bfbf82de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11045a7f2937421ab64640d5bfbf82de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45789 } } }
I20260812 16:46:17.918294 29021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:17.918299 29024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:17.919162 29031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:17.919821 29031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:17.921447 29031 catalog_manager.cc:1347] Generated new cluster ID: 295514a751c9440eb3dd68c305269e5e
I20260812 16:46:17.921507 29031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:46:17 dist-test-slave-45dx krb5kdc[28841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 16:46:17.926684 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:17.914072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:33561 (local address 127.0.0.1:45789)
0812 16:46:17.914248 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:17.914260 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:17.914302 (+ 42us) server_negotiation.cc:407] Connection header received
0812 16:46:17.915119 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:17.915127 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:17.915179 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:17.915331 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:17.916044 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:17.917877 (+ 1833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:17.919048 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:17.919690 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:17.919802 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:17.922816 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:17.922820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:17.922821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:17.922833 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:17.924872 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:17.925342 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:17.925344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:17.925345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:17.925458 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:17.925742 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:17.925742 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:17.925743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:17.926041 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:17.926207 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:17.926380 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 16:46:17.926480 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260812 16:46:17.927678 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:17.936875 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:17.929231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:60861 (local address 127.0.0.1:45789)
0812 16:46:17.929285 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:17.929288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:17.929409 (+ 121us) server_negotiation.cc:407] Connection header received
0812 16:46:17.929472 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:17.929473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:17.929485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:17.929543 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:17.930165 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:17.930918 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:17.931884 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:17.932215 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:17.932290 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:17.933719 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:17.933721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:17.933721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:17.933729 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:17.935463 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:17.935888 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:17.935889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:17.935890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:17.935952 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:17.936194 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:17.936195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:17.936196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:17.936349 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:17.936464 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:17.936697 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 16:46:17.936769 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 16:46:17.936887 29031 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:17.937584 29031 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:17.943832 29031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11045a7f2937421ab64640d5bfbf82de: Generated new TSK 0
I20260812 16:46:17.944046 29031 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:17.948941 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 28875
W20260812 16:46:17.969102 28839 connection.cc:535] client connection to 127.0.0.1:45789 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45789): Connection reset by peer (error 104)
2026-08-12T16:46:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1615 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:18 dist-test-slave-45dx krb5kdc[29062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:18 dist-test-slave-45dx krb5kdc[29062](info): set up 2 sockets
Aug 12 16:46:18 dist-test-slave-45dx krb5kdc[29062](info): commencing operation
krb5kdc: starting...
W20260812 16:46:19.292141 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:19 dist-test-slave-45dx krb5kdc[29062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:19.417294 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34255
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:19.500592 29085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:19.500851 29085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:19.500903 29085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:19.502074 29085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:19.502146 29085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:19.502170 29085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:19.502202 29085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:19.502230 29085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:19.503703 29085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:19.503991 29085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:19.504223 29085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:19.509122 29100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:19.509135 29102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:19.509266 29085 server_base.cc:1034] running on GCE node
W20260812 16:46:19.509135 29105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:19.509567 29085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:19.509891 29085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:19.511067 29085 hybrid_clock.cc:648] HybridClock initialized: now 1786553179511046 us; error 34 us; skew 500 ppm
Aug 12 16:46:19 dist-test-slave-45dx krb5kdc[29062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553179, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:19.513537 29085 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:19.513973 29085 webserver.cc:460] Webserver started at http://127.0.0.1:42775/ using document root <none> and password file <none>
I20260812 16:46:19.514194 29085 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:19.514261 29085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:19.514420 29085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:19.515507 29085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "30d958b6bfc5427f858f15ec8dfa1364"
format_stamp: "Formatted at 2026-08-12 16:46:19 on dist-test-slave-45dx"
server_key: "091d72970268ae37a82da14d420c164e"
server_key_iv: "859311fbb816eb9d81b909ac4c0cf0f6"
server_key_version: "encryptionkey@0"
I20260812 16:46:19.515892 29085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "30d958b6bfc5427f858f15ec8dfa1364"
format_stamp: "Formatted at 2026-08-12 16:46:19 on dist-test-slave-45dx"
server_key: "091d72970268ae37a82da14d420c164e"
server_key_iv: "859311fbb816eb9d81b909ac4c0cf0f6"
server_key_version: "encryptionkey@0"
I20260812 16:46:19.517324 29085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:46:19.518059 29120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:19.518230 29085 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:46:19.518333 29085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "30d958b6bfc5427f858f15ec8dfa1364"
format_stamp: "Formatted at 2026-08-12 16:46:19 on dist-test-slave-45dx"
server_key: "091d72970268ae37a82da14d420c164e"
server_key_iv: "859311fbb816eb9d81b909ac4c0cf0f6"
server_key_version: "encryptionkey@0"
I20260812 16:46:19.518414 29085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:19.535730 29085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:19.537649 29085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:19.537873 29085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:19.542088 29085 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34255
I20260812 16:46:19.542157 29218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34255 every 8 connection(s)
I20260812 16:46:19.542534 29085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:19.543429 29221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:19.545753 29221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364: Bootstrap starting.
I20260812 16:46:19.546295 29221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:19.546542 29221 log.cc:824] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:19.547225 29221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364: No bootstrap required, opened a new log
I20260812 16:46:19.548817 29221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d958b6bfc5427f858f15ec8dfa1364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34255 } }
I20260812 16:46:19.548955 29221 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:19.548978 29221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d958b6bfc5427f858f15ec8dfa1364, State: Initialized, Role: FOLLOWER
I20260812 16:46:19.549083 29221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d958b6bfc5427f858f15ec8dfa1364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34255 } }
I20260812 16:46:19.549165 29221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:19.549201 29221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:19.549255 29221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:19.549806 29221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d958b6bfc5427f858f15ec8dfa1364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34255 } }
I20260812 16:46:19.549939 29221 leader_election.cc:302] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30d958b6bfc5427f858f15ec8dfa1364; no voters:
I20260812 16:46:19.550122 29221 leader_election.cc:288] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:19.550173 29227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:19.550379 29227 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [term 1 LEADER]: Becoming Leader. State: Replica: 30d958b6bfc5427f858f15ec8dfa1364, State: Running, Role: LEADER
I20260812 16:46:19.550401 29221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:19.550479 29227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d958b6bfc5427f858f15ec8dfa1364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34255 } }
I20260812 16:46:19.551066 29229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30d958b6bfc5427f858f15ec8dfa1364. Latest consensus state: current_term: 1 leader_uuid: "30d958b6bfc5427f858f15ec8dfa1364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d958b6bfc5427f858f15ec8dfa1364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34255 } } }
I20260812 16:46:19.551170 29229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:19.551342 29228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30d958b6bfc5427f858f15ec8dfa1364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d958b6bfc5427f858f15ec8dfa1364" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34255 } } }
I20260812 16:46:19.551411 29228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:19.551537 29240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:19.552143 29240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:19.552697 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29085
I20260812 16:46:19.552836 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:19.553020 21961 external_mini_cluster.cc:1428] Setting key 233758bd2842841d82078b6768263c64
I20260812 16:46:19.556756 29240 catalog_manager.cc:1347] Generated new cluster ID: dc28847d22b64505968312e4c5fd0b05
I20260812 16:46:19.556836 29240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:19.562587 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:19.553494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:51149 (local address 127.0.0.1:34255)
0812 16:46:19.556820 (+ 3326us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:19.556830 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:19.556865 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:46:19.556999 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:19.557006 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:19.557067 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:19.557223 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:19.557479 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:19.558989 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:19.560055 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:19.560848 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:19.560967 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:19.561762 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:19.561766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:19.561766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:19.561983 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:19.562025 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:19.562042 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:19.562138 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:19.562224 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 16:46:19.562372 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3278,"thread_start_us":103,"threads_started":1}
I20260812 16:46:19.563692 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:19.568900 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:19.565244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:34005 (local address 127.0.0.1:34255)
0812 16:46:19.565285 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:19.565287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:19.565463 (+ 176us) server_negotiation.cc:407] Connection header received
0812 16:46:19.565522 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:19.565523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:19.565535 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:19.565585 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:19.565728 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:19.566442 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:19.567469 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:19.567776 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:19.567836 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:19.568626 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:19.568627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:19.568627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:19.568632 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:19.568647 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:19.568652 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:19.568716 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:19.568815 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 16:46:19.568827 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:19.571276 29240 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:19.571748 29240 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:19.580132 29240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30d958b6bfc5427f858f15ec8dfa1364: Generated new TSK 0
I20260812 16:46:19.580365 29240 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:19.582080 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29085
W20260812 16:46:19.602655 29060 connection.cc:535] client connection to 127.0.0.1:34255 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34255): Connection reset by peer (error 104)
2026-08-12T16:46:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1633 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:19 dist-test-slave-45dx krb5kdc[29277](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:19 dist-test-slave-45dx krb5kdc[29277](info): set up 2 sockets
Aug 12 16:46:19 dist-test-slave-45dx krb5kdc[29277](info): commencing operation
krb5kdc: starting...
W20260812 16:46:20.904170 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:20 dist-test-slave-45dx krb5kdc[29277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:21.028679 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33869
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:21.110893 29312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:21.111106 29312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:21.111130 29312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:21.112200 29312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:21.112234 29312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:21.112249 29312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:21.112262 29312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:21.112273 29312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:21.113711 29312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:21.113901 29312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:21.114079 29312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:21.118965 29326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:21.118953 29333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:21.118958 29325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:21.119261 29312 server_base.cc:1034] running on GCE node
I20260812 16:46:21.119500 29312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:21.119743 29312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:21.120914 29312 hybrid_clock.cc:648] HybridClock initialized: now 1786553181120900 us; error 29 us; skew 500 ppm
Aug 12 16:46:21 dist-test-slave-45dx krb5kdc[29277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553181, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:21.128598 29312 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:21.129066 29312 webserver.cc:460] Webserver started at http://127.0.0.1:34789/ using document root <none> and password file <none>
I20260812 16:46:21.129324 29312 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:21.129370 29312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:21.129546 29312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:21.130652 29312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "80285e115f054972983d8389e3d112d6"
format_stamp: "Formatted at 2026-08-12 16:46:21 on dist-test-slave-45dx"
server_key: "cfbf6895fb8f2b36070f358459ea9975"
server_key_iv: "8299cb902746023fe27ef305696cba1b"
server_key_version: "encryptionkey@0"
I20260812 16:46:21.131027 29312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "80285e115f054972983d8389e3d112d6"
format_stamp: "Formatted at 2026-08-12 16:46:21 on dist-test-slave-45dx"
server_key: "cfbf6895fb8f2b36070f358459ea9975"
server_key_iv: "8299cb902746023fe27ef305696cba1b"
server_key_version: "encryptionkey@0"
I20260812 16:46:21.132428 29312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:21.133201 29347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:21.133415 29312 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:21.133528 29312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "80285e115f054972983d8389e3d112d6"
format_stamp: "Formatted at 2026-08-12 16:46:21 on dist-test-slave-45dx"
server_key: "cfbf6895fb8f2b36070f358459ea9975"
server_key_iv: "8299cb902746023fe27ef305696cba1b"
server_key_version: "encryptionkey@0"
I20260812 16:46:21.133611 29312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:21.137204 29312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:21.139518 29312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:21.139675 29312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:21.143754 29312 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33869
I20260812 16:46:21.143788 29439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33869 every 8 connection(s)
I20260812 16:46:21.144111 29312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:21.145162 29440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:21.147382 29440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6: Bootstrap starting.
I20260812 16:46:21.147969 29440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:21.148265 29440 log.cc:824] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:21.149080 29440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6: No bootstrap required, opened a new log
I20260812 16:46:21.150667 29440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80285e115f054972983d8389e3d112d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33869 } }
I20260812 16:46:21.150802 29440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:21.150826 29440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80285e115f054972983d8389e3d112d6, State: Initialized, Role: FOLLOWER
I20260812 16:46:21.150978 29440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80285e115f054972983d8389e3d112d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33869 } }
I20260812 16:46:21.151062 29440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:21.151131 29440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:21.151186 29440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:21.151729 29440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80285e115f054972983d8389e3d112d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33869 } }
I20260812 16:46:21.151857 29440 leader_election.cc:302] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80285e115f054972983d8389e3d112d6; no voters:
I20260812 16:46:21.152050 29440 leader_election.cc:288] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:21.152117 29445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:21.152275 29445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [term 1 LEADER]: Becoming Leader. State: Replica: 80285e115f054972983d8389e3d112d6, State: Running, Role: LEADER
I20260812 16:46:21.152333 29440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:21.152419 29445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80285e115f054972983d8389e3d112d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33869 } }
I20260812 16:46:21.153002 29447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80285e115f054972983d8389e3d112d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80285e115f054972983d8389e3d112d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33869 } } }
I20260812 16:46:21.153028 29450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80285e115f054972983d8389e3d112d6. Latest consensus state: current_term: 1 leader_uuid: "80285e115f054972983d8389e3d112d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80285e115f054972983d8389e3d112d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33869 } } }
I20260812 16:46:21.153153 29450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:21.153424 29465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:21.153621 29447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:21.153726 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29312
I20260812 16:46:21.153861 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:21.154052 21961 external_mini_cluster.cc:1428] Setting key e59542bfd1a5011c2d251fae73c0b35f
I20260812 16:46:21.154732 29465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:21.156391 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:21.154537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:49743 (local address 127.0.0.1:33869)
0812 16:46:21.154764 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:21.154773 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:21.154809 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:46:21.154934 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:21.154942 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:21.154972 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:21.155132 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:21.155786 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:21.155790 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:21.155790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:21.155794 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:21.155838 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:21.155863 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:21.155919 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:21.156131 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 16:46:21.156175 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
I20260812 16:46:21.156406 29465 catalog_manager.cc:1347] Generated new cluster ID: 177bd5aafa034bdc80d3b42cfd2c9245
I20260812 16:46:21.156494 29465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:21.157303 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:21.159994 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:21.158974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:53851 (local address 127.0.0.1:33869)
0812 16:46:21.159037 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:21.159038 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:21.159047 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:21.159144 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:21.159145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:21.159151 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:21.159198 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:21.159766 (+ 568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:21.159767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:21.159767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:21.159771 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:21.159786 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:21.159790 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:21.159844 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:21.159908 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 16:46:21.159920 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 16:46:21.173158 29465 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:21.173348 29465 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:21.179088 29465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80285e115f054972983d8389e3d112d6: Generated new TSK 0
I20260812 16:46:21.179301 29465 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:21.186586 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29312
2026-08-12T16:46:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:21 dist-test-slave-45dx krb5kdc[29501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:21 dist-test-slave-45dx krb5kdc[29501](info): set up 2 sockets
Aug 12 16:46:21 dist-test-slave-45dx krb5kdc[29501](info): commencing operation
krb5kdc: starting...
W20260812 16:46:22.503067 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:22 dist-test-slave-45dx krb5kdc[29501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:22.626686 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:22.711457 29526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:22.711683 29526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:22.711707 29526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:22.712937 29526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:22.712980 29526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:22.712994 29526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:22.713044 29526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:22.713071 29526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:22.714570 29526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40081
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:22.714823 29526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:22.715063 29526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:22.719878 29540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:22.719916 29543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:22.720134 29526 server_base.cc:1034] running on GCE node
W20260812 16:46:22.719892 29539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:22.720551 29526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:22.720872 29526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:22.722043 29526 hybrid_clock.cc:648] HybridClock initialized: now 1786553182722028 us; error 45 us; skew 500 ppm
Aug 12 16:46:22 dist-test-slave-45dx krb5kdc[29501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553182, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:22.724589 29526 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:22.725013 29526 webserver.cc:460] Webserver started at http://127.0.0.1:39669/ using document root <none> and password file <none>
I20260812 16:46:22.725255 29526 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:22.725324 29526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:22.725482 29526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:22.726517 29526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "ea72d91d0b44411dba012ea8cb99835e"
format_stamp: "Formatted at 2026-08-12 16:46:22 on dist-test-slave-45dx"
server_key: "41f39eeaabf88583a98642c4eb23c816"
server_key_iv: "c3ba45d01dec9e8e316bc98216227118"
server_key_version: "encryptionkey@0"
I20260812 16:46:22.726877 29526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "ea72d91d0b44411dba012ea8cb99835e"
format_stamp: "Formatted at 2026-08-12 16:46:22 on dist-test-slave-45dx"
server_key: "41f39eeaabf88583a98642c4eb23c816"
server_key_iv: "c3ba45d01dec9e8e316bc98216227118"
server_key_version: "encryptionkey@0"
I20260812 16:46:22.728214 29526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:46:22.729012 29552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:22.729187 29526 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:22.729291 29526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "ea72d91d0b44411dba012ea8cb99835e"
format_stamp: "Formatted at 2026-08-12 16:46:22 on dist-test-slave-45dx"
server_key: "41f39eeaabf88583a98642c4eb23c816"
server_key_iv: "c3ba45d01dec9e8e316bc98216227118"
server_key_version: "encryptionkey@0"
I20260812 16:46:22.729373 29526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:22.742228 29526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:22.744664 29526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:22.744827 29526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:22.748948 29526 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40081
I20260812 16:46:22.748986 29654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40081 every 8 connection(s)
I20260812 16:46:22.749346 29526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:22.750207 29658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:22.752068 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29526
I20260812 16:46:22.752213 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:22.752429 21961 external_mini_cluster.cc:1428] Setting key 6bd9b4c081d2afa983ac68eec109e23c
I20260812 16:46:22.752663 29658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e: Bootstrap starting.
I20260812 16:46:22.753445 29658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:22.753785 29658 log.cc:824] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:22.754544 29658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e: No bootstrap required, opened a new log
I20260812 16:46:22.756850 29658 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea72d91d0b44411dba012ea8cb99835e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40081 } }
I20260812 16:46:22.757035 29658 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:22.757072 29658 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea72d91d0b44411dba012ea8cb99835e, State: Initialized, Role: FOLLOWER
I20260812 16:46:22.757191 29658 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea72d91d0b44411dba012ea8cb99835e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40081 } }
I20260812 16:46:22.757266 29658 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:22.757295 29658 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:22.757333 29658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:22.758116 29658 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea72d91d0b44411dba012ea8cb99835e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40081 } }
I20260812 16:46:22.758240 29658 leader_election.cc:302] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea72d91d0b44411dba012ea8cb99835e; no voters:
I20260812 16:46:22.758472 29658 leader_election.cc:288] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:22.758492 29670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:22.758615 29670 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [term 1 LEADER]: Becoming Leader. State: Replica: ea72d91d0b44411dba012ea8cb99835e, State: Running, Role: LEADER
I20260812 16:46:22.758752 29658 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:22.758754 29670 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea72d91d0b44411dba012ea8cb99835e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40081 } }
I20260812 16:46:22.759265 29673 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea72d91d0b44411dba012ea8cb99835e. Latest consensus state: current_term: 1 leader_uuid: "ea72d91d0b44411dba012ea8cb99835e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea72d91d0b44411dba012ea8cb99835e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40081 } } }
I20260812 16:46:22.759363 29673 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:22.759580 29672 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea72d91d0b44411dba012ea8cb99835e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea72d91d0b44411dba012ea8cb99835e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40081 } } }
I20260812 16:46:22.759900 29672 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e [sys.catalog]: This master's current role is: LEADER
Aug 12 16:46:22 dist-test-slave-45dx krb5kdc[29501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 16:46:22.760054 29679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:22.760654 29679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:22.762423 29679 catalog_manager.cc:1347] Generated new cluster ID: 0436d10aa5194cf3b92348cffbee8002
I20260812 16:46:22.762475 29679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:22.764765 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:22.752974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:58899 (local address 127.0.0.1:40081)
0812 16:46:22.753171 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:22.753181 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:22.753216 (+ 35us) server_negotiation.cc:407] Connection header received
0812 16:46:22.753877 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:22.753887 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:22.753958 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:22.754099 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:22.754762 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:22.756188 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:22.756973 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:22.757629 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:22.757744 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:22.760844 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:22.760848 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:22.760848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:22.760860 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:22.762916 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:22.763327 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:22.763330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:22.763330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:22.763426 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:22.763633 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:22.763634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:22.763635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:22.763909 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:22.764047 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:22.764470 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 16:46:22.764565 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260812 16:46:22.765690 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:22.774375 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:22.767081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:48327 (local address 127.0.0.1:40081)
0812 16:46:22.767112 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:22.767114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:22.767239 (+ 125us) server_negotiation.cc:407] Connection header received
0812 16:46:22.767298 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:22.767298 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:22.767307 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:22.767360 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:22.768008 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:22.768741 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:22.769758 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:22.770088 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:22.770149 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:22.771570 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:22.771572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:22.771572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:22.771579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:22.773135 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:22.773566 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:22.773567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:22.773567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:22.773622 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:22.773850 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:22.773851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:22.773852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:22.773965 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:22.774069 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:22.774233 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 16:46:22.774293 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 16:46:22.777935 29679 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:22.778424 29679 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:22.785027 29679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea72d91d0b44411dba012ea8cb99835e: Generated new TSK 0
I20260812 16:46:22.785211 29679 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:22.789310 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29526
W20260812 16:46:22.813247 29498 connection.cc:535] client connection to 127.0.0.1:40081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40081): Connection reset by peer (error 104)
2026-08-12T16:46:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:22 dist-test-slave-45dx krb5kdc[29715](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:22 dist-test-slave-45dx krb5kdc[29715](info): set up 2 sockets
Aug 12 16:46:22 dist-test-slave-45dx krb5kdc[29715](info): commencing operation
krb5kdc: starting...
W20260812 16:46:24.131253 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:24 dist-test-slave-45dx krb5kdc[29715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:24.256911 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37921
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:24.345248 29739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:24.345465 29739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:24.345489 29739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:24.346654 29739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:24.346701 29739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:24.346716 29739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:24.346728 29739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:24.346786 29739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:24.348281 29739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37921
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:24.348613 29739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:24.348856 29739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:24.353863 29750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:24.354048 29739 server_base.cc:1034] running on GCE node
W20260812 16:46:24.353874 29749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:24.353915 29753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:24.354427 29739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:24.354725 29739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:24.355891 29739 hybrid_clock.cc:648] HybridClock initialized: now 1786553184355873 us; error 35 us; skew 500 ppm
Aug 12 16:46:24 dist-test-slave-45dx krb5kdc[29715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553184, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:24.358485 29739 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:24.358946 29739 webserver.cc:460] Webserver started at http://127.0.0.1:41603/ using document root <none> and password file <none>
I20260812 16:46:24.359185 29739 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:24.359230 29739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:24.359401 29739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:24.360559 29739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "e9167d19411a46c6ab6cb6ae3778b10c"
format_stamp: "Formatted at 2026-08-12 16:46:24 on dist-test-slave-45dx"
server_key: "c2206f93b8a6d817337d04bc322b3f79"
server_key_iv: "0fafa74ec5d602dd800832ff6285231b"
server_key_version: "encryptionkey@0"
I20260812 16:46:24.360934 29739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "e9167d19411a46c6ab6cb6ae3778b10c"
format_stamp: "Formatted at 2026-08-12 16:46:24 on dist-test-slave-45dx"
server_key: "c2206f93b8a6d817337d04bc322b3f79"
server_key_iv: "0fafa74ec5d602dd800832ff6285231b"
server_key_version: "encryptionkey@0"
I20260812 16:46:24.362389 29739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:24.363216 29765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:24.363435 29739 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:24.363549 29739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "e9167d19411a46c6ab6cb6ae3778b10c"
format_stamp: "Formatted at 2026-08-12 16:46:24 on dist-test-slave-45dx"
server_key: "c2206f93b8a6d817337d04bc322b3f79"
server_key_iv: "0fafa74ec5d602dd800832ff6285231b"
server_key_version: "encryptionkey@0"
I20260812 16:46:24.363627 29739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:24.377456 29739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:24.379953 29739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:24.380136 29739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:24.384451 29739 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37921
I20260812 16:46:24.384526 29869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37921 every 8 connection(s)
I20260812 16:46:24.384893 29739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:24.385805 29870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:24.388094 29870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c: Bootstrap starting.
I20260812 16:46:24.388767 29870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:24.389067 29870 log.cc:824] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:24.389798 29870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c: No bootstrap required, opened a new log
I20260812 16:46:24.391780 29870 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37921 } }
I20260812 16:46:24.391993 29870 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:24.392051 29870 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9167d19411a46c6ab6cb6ae3778b10c, State: Initialized, Role: FOLLOWER
I20260812 16:46:24.392194 29870 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37921 } }
I20260812 16:46:24.392282 29870 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:24.392343 29870 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:24.392400 29870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:24.392484 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29739
I20260812 16:46:24.392645 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:24.392848 21961 external_mini_cluster.cc:1428] Setting key e80a45b9928cf23d19572e9618011553
I20260812 16:46:24.393180 29870 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37921 } }
I20260812 16:46:24.393596 29870 leader_election.cc:302] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9167d19411a46c6ab6cb6ae3778b10c; no voters:
I20260812 16:46:24.393795 29870 leader_election.cc:288] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:24.394153 29870 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:24.394307 29878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:24.394501 29878 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [term 1 LEADER]: Becoming Leader. State: Replica: e9167d19411a46c6ab6cb6ae3778b10c, State: Running, Role: LEADER
I20260812 16:46:24.394675 29878 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37921 } }
I20260812 16:46:24.395231 29877 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37921 } } }
I20260812 16:46:24.395334 29877 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:24.395476 29877 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9167d19411a46c6ab6cb6ae3778b10c. Latest consensus state: current_term: 1 leader_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9167d19411a46c6ab6cb6ae3778b10c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37921 } } }
I20260812 16:46:24.395537 29877 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c [sys.catalog]: This master's current role is: LEADER
W20260812 16:46:24.396579 29905 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:24.396664 29905 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:24.397583 29893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:24.397781 29893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:24.399451 29893 catalog_manager.cc:1347] Generated new cluster ID: dfc5668a9e494fe3a3bd1f07ca1c1f48
I20260812 16:46:24.399519 29893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:24.400202 29875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:24.393401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:50201 (local address 127.0.0.1:37921)
0812 16:46:24.393601 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:24.393611 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:24.393648 (+ 37us) server_negotiation.cc:407] Connection header received
0812 16:46:24.393791 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:24.393799 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:24.393891 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:24.394036 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:24.394264 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:24.396434 (+ 2170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:24.397578 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:24.398394 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:24.398504 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:24.399359 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:24.399363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:24.399363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:24.399581 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:24.399620 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:24.399634 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:24.399715 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:24.399952 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 16:46:24.399981 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260812 16:46:24.401183 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:24.406626 29875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:24.402741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:47681 (local address 127.0.0.1:37921)
0812 16:46:24.402781 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:24.402783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:24.402881 (+ 98us) server_negotiation.cc:407] Connection header received
0812 16:46:24.402976 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:24.402977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:24.402988 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:24.403018 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:24.403227 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:24.404056 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:24.405158 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:24.405486 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:24.405530 (+ 44us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:24.406344 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:24.406345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:24.406346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:24.406351 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:24.406365 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:24.406370 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:24.406403 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:24.406537 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 16:46:24.406552 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:46:24.420094 29893 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:24.420945 29893 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:24.437409 29893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9167d19411a46c6ab6cb6ae3778b10c: Generated new TSK 0
I20260812 16:46:24.437649 29893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:24.443996 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29739
W20260812 16:46:24.461344 29712 connection.cc:535] client connection to 127.0.0.1:37921 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37921): Connection reset by peer (error 104)
2026-08-12T16:46:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1648 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:24 dist-test-slave-45dx krb5kdc[29925](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:24 dist-test-slave-45dx krb5kdc[29925](info): set up 2 sockets
Aug 12 16:46:24 dist-test-slave-45dx krb5kdc[29925](info): commencing operation
krb5kdc: starting...
W20260812 16:46:25.766453 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:25 dist-test-slave-45dx krb5kdc[29925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 16:46:25.891562 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34119
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:25.974926 29952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:25.975136 29952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:25.975159 29952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:25.976413 29952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:25.976455 29952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:25.976470 29952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:25.976504 29952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:25.976536 29952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:25.978031 29952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34119
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:25.978281 29952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:25.978520 29952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:25.983659 29960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:25.983635 29963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:25.983654 29952 server_base.cc:1034] running on GCE node
W20260812 16:46:25.983631 29959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:25.984238 29952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:25.984589 29952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:25.985733 29952 hybrid_clock.cc:648] HybridClock initialized: now 1786553185985722 us; error 28 us; skew 500 ppm
Aug 12 16:46:25 dist-test-slave-45dx krb5kdc[29925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:25.988220 29952 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 16:46:25.988727 29952 webserver.cc:460] Webserver started at http://127.0.0.1:42857/ using document root <none> and password file <none>
I20260812 16:46:25.988963 29952 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:25.989033 29952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:25.989190 29952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:25.990296 29952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "a315331df87e415cb1cca1e6822503c6"
format_stamp: "Formatted at 2026-08-12 16:46:25 on dist-test-slave-45dx"
server_key: "721a481ab7f1858710980b1589f00f77"
server_key_iv: "163615d39b5a75c8332a8e5bca4f0db8"
server_key_version: "encryptionkey@0"
I20260812 16:46:25.990671 29952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "a315331df87e415cb1cca1e6822503c6"
format_stamp: "Formatted at 2026-08-12 16:46:25 on dist-test-slave-45dx"
server_key: "721a481ab7f1858710980b1589f00f77"
server_key_iv: "163615d39b5a75c8332a8e5bca4f0db8"
server_key_version: "encryptionkey@0"
I20260812 16:46:25.992028 29952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260812 16:46:25.992846 29977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:25.993043 29952 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:25.993147 29952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "a315331df87e415cb1cca1e6822503c6"
format_stamp: "Formatted at 2026-08-12 16:46:25 on dist-test-slave-45dx"
server_key: "721a481ab7f1858710980b1589f00f77"
server_key_iv: "163615d39b5a75c8332a8e5bca4f0db8"
server_key_version: "encryptionkey@0"
I20260812 16:46:25.993233 29952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:25.996498 29952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:25.998360 29952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:25.998535 29952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:26.002718 29952 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34119
I20260812 16:46:26.002772 30070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34119 every 8 connection(s)
I20260812 16:46:26.003096 29952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:26.004078 30072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:26.006332 30072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6: Bootstrap starting.
I20260812 16:46:26.006659 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 29952
I20260812 16:46:26.006784 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:26.006978 21961 external_mini_cluster.cc:1428] Setting key 583062309ddbafad3ab2213fa3da255d
I20260812 16:46:26.007035 30072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:26.007380 30072 log.cc:824] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:26.008148 30072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6: No bootstrap required, opened a new log
I20260812 16:46:26.009536 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:26.007491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:43537 (local address 127.0.0.1:34119)
0812 16:46:26.007719 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:26.007729 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:26.007763 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:46:26.008212 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:26.008219 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:26.008270 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:26.008438 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:26.009082 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:26.009085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:26.009085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:26.009089 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:26.009126 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:26.009137 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:26.009206 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:26.009285 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 16:46:26.009343 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":94,"threads_started":1}
I20260812 16:46:26.010571 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:26.010823 30072 raft_consensus.cc:348] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a315331df87e415cb1cca1e6822503c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34119 } }
I20260812 16:46:26.010973 30072 raft_consensus.cc:374] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:26.011022 30072 raft_consensus.cc:729] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a315331df87e415cb1cca1e6822503c6, State: Initialized, Role: FOLLOWER
I20260812 16:46:26.011135 30072 consensus_queue.cc:260] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a315331df87e415cb1cca1e6822503c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34119 } }
I20260812 16:46:26.011222 30072 raft_consensus.cc:388] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:26.011245 30072 raft_consensus.cc:482] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:26.011312 30072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:26.011868 30072 raft_consensus.cc:504] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a315331df87e415cb1cca1e6822503c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34119 } }
I20260812 16:46:26.011991 30072 leader_election.cc:302] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a315331df87e415cb1cca1e6822503c6; no voters:
I20260812 16:46:26.012171 30072 leader_election.cc:288] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:26.012197 30086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:26.012485 30086 raft_consensus.cc:686] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [term 1 LEADER]: Becoming Leader. State: Replica: a315331df87e415cb1cca1e6822503c6, State: Running, Role: LEADER
I20260812 16:46:26.012614 30072 sys_catalog.cc:564] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:26.012646 30086 consensus_queue.cc:237] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a315331df87e415cb1cca1e6822503c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34119 } }
I20260812 16:46:26.013036 30086 sys_catalog.cc:455] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a315331df87e415cb1cca1e6822503c6. Latest consensus state: current_term: 1 leader_uuid: "a315331df87e415cb1cca1e6822503c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a315331df87e415cb1cca1e6822503c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34119 } } }
I20260812 16:46:26.013048 30090 sys_catalog.cc:455] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a315331df87e415cb1cca1e6822503c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a315331df87e415cb1cca1e6822503c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34119 } } }
I20260812 16:46:26.013240 30090 sys_catalog.cc:458] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:26.013170 30086 sys_catalog.cc:458] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:26.013940 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:26.012031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:33693 (local address 127.0.0.1:34119)
0812 16:46:26.012087 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:26.012089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:26.012227 (+ 138us) server_negotiation.cc:407] Connection header received
0812 16:46:26.012268 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:26.012270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:26.012275 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:26.012417 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:26.013661 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:26.013662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:26.013663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:26.013672 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:26.013688 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:26.013693 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:26.013752 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:26.013835 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 16:46:26.013851 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 16:46:26.014707 30111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:26.014775 30111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:26.014875 30101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:26.015069 30101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:26.016716 30101 catalog_manager.cc:1347] Generated new cluster ID: 4adc87af0abe42a79da001688a2535e0
I20260812 16:46:26.016785 30101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:26.030714 30101 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:26.030907 30101 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:26.042990 30101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a315331df87e415cb1cca1e6822503c6: Generated new TSK 0
I20260812 16:46:26.043210 30101 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:26.051995 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 29952
2026-08-12T16:46:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:26 dist-test-slave-45dx krb5kdc[30117](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:26 dist-test-slave-45dx krb5kdc[30117](info): set up 2 sockets
Aug 12 16:46:26 dist-test-slave-45dx krb5kdc[30117](info): commencing operation
krb5kdc: starting...
W20260812 16:46:27.373044 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:27 dist-test-slave-45dx krb5kdc[30117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:27.498994 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36373
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:36373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:27.582863 30140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:27.583083 30140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:27.583106 30140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:27.584285 30140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:27.584383 30140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:27.584401 30140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:27.584415 30140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:27.584427 30140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:27.586226 30140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:36373
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:36373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:27.586473 30140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:27.586745 30140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:27.592141 30153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:27.592180 30150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:27.592276 30140 server_base.cc:1034] running on GCE node
W20260812 16:46:27.592180 30156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:27.592610 30140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:27.592949 30140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:27.594107 30140 hybrid_clock.cc:648] HybridClock initialized: now 1786553187594097 us; error 38 us; skew 500 ppm
Aug 12 16:46:27 dist-test-slave-45dx krb5kdc[30117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553187, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:27.601677 30140 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:27.602187 30140 webserver.cc:460] Webserver started at http://127.21.114.126:36821/ using document root <none> and password file <none>
I20260812 16:46:27.602437 30140 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:27.602505 30140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:27.602650 30140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:27.603767 30140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "58659581c36d4c6c8cd0efba9657d418"
format_stamp: "Formatted at 2026-08-12 16:46:27 on dist-test-slave-45dx"
server_key: "e937c222fd8f38dc244556c9397980f3"
server_key_iv: "a06871617aa5ee2c412a6a454f1e1dbc"
server_key_version: "encryptionkey@0"
I20260812 16:46:27.604138 30140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "58659581c36d4c6c8cd0efba9657d418"
format_stamp: "Formatted at 2026-08-12 16:46:27 on dist-test-slave-45dx"
server_key: "e937c222fd8f38dc244556c9397980f3"
server_key_iv: "a06871617aa5ee2c412a6a454f1e1dbc"
server_key_version: "encryptionkey@0"
I20260812 16:46:27.605683 30140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:27.606431 30168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:27.606602 30140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:46:27.606707 30140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "58659581c36d4c6c8cd0efba9657d418"
format_stamp: "Formatted at 2026-08-12 16:46:27 on dist-test-slave-45dx"
server_key: "e937c222fd8f38dc244556c9397980f3"
server_key_iv: "a06871617aa5ee2c412a6a454f1e1dbc"
server_key_version: "encryptionkey@0"
I20260812 16:46:27.606778 30140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:27.613135 30140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:27.614933 30140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:27.615087 30140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:27.619131 30140 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:36373
I20260812 16:46:27.619163 30270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:36373 every 8 connection(s)
I20260812 16:46:27.619513 30140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:27.620412 30271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:27.622651 30271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418: Bootstrap starting.
I20260812 16:46:27.623181 30271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:27.623427 30271 log.cc:824] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:27.623951 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30140
I20260812 16:46:27.624074 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:27.624140 30271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418: No bootstrap required, opened a new log
I20260812 16:46:27.624264 21961 external_mini_cluster.cc:1428] Setting key c31de808d7a512f60e6f7ce31353aad9
I20260812 16:46:27.626502 30271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58659581c36d4c6c8cd0efba9657d418" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36373 } }
I20260812 16:46:27.626683 30271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:27.626724 30271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58659581c36d4c6c8cd0efba9657d418, State: Initialized, Role: FOLLOWER
I20260812 16:46:27.626876 30271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58659581c36d4c6c8cd0efba9657d418" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36373 } }
I20260812 16:46:27.626965 30271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:27.626996 30271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:27.627043 30271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:27.627753 30271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58659581c36d4c6c8cd0efba9657d418" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36373 } }
I20260812 16:46:27.627862 30271 leader_election.cc:302] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58659581c36d4c6c8cd0efba9657d418; no voters:
I20260812 16:46:27.628005 30271 leader_election.cc:288] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:27.628057 30277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:27.628233 30271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:27.628242 30277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [term 1 LEADER]: Becoming Leader. State: Replica: 58659581c36d4c6c8cd0efba9657d418, State: Running, Role: LEADER
I20260812 16:46:27.628502 30277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58659581c36d4c6c8cd0efba9657d418" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36373 } }
I20260812 16:46:27.629560 30278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58659581c36d4c6c8cd0efba9657d418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58659581c36d4c6c8cd0efba9657d418" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36373 } } }
I20260812 16:46:27.629670 30278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:27.629645 30280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58659581c36d4c6c8cd0efba9657d418. Latest consensus state: current_term: 1 leader_uuid: "58659581c36d4c6c8cd0efba9657d418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58659581c36d4c6c8cd0efba9657d418" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 36373 } } }
I20260812 16:46:27.629736 30280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418 [sys.catalog]: This master's current role is: LEADER
W20260812 16:46:27.630311 30300 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:27.630414 30300 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:27.630615 30301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:27.630786 30301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:27.632103 30301 catalog_manager.cc:1347] Generated new cluster ID: 96f88649f8b84cef9f36e02fd27433f4
I20260812 16:46:27.632156 30301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:46:27 dist-test-slave-45dx krb5kdc[30117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:27.637163 30276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:27.624786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41589 (local address 127.21.114.126:36373)
0812 16:46:27.625027 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:27.625036 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:27.625070 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:46:27.625682 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:27.625692 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:27.625756 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:27.625909 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:27.626502 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:27.628217 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:27.629326 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:27.630000 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:27.630108 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:27.633014 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:27.633018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:27.633018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:27.633030 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:27.634991 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:27.635456 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:27.635459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:27.635460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:27.635564 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:27.635813 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:27.635814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:27.635814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:27.636098 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:27.636777 (+ 679us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:27.636868 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 16:46:27.636974 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":129,"threads_started":1}
I20260812 16:46:27.638186 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:27.646835 30276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:27.639628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45505 (local address 127.21.114.126:36373)
0812 16:46:27.639662 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:27.639663 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:27.639733 (+ 70us) server_negotiation.cc:407] Connection header received
0812 16:46:27.639804 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:27.639805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:27.639813 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:27.639871 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:27.640509 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:27.641224 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:27.642250 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:27.642582 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:27.642641 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:27.644001 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:27.644002 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:27.644002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:27.644009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:27.645575 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:27.645982 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:27.645982 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:27.645983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:27.646039 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:27.646323 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:27.646324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:27.646324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:27.646442 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:27.646528 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:27.646691 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 16:46:27.646751 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 16:46:27.651777 30301 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:27.652424 30301 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:27.655524 30301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58659581c36d4c6c8cd0efba9657d418: Generated new TSK 0
I20260812 16:46:27.655705 30301 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:27.658196 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30140
W20260812 16:46:27.674242 30115 connection.cc:535] client connection to 127.21.114.126:36373 recv error: Network error: failed to read from TLS socket (remote: 127.21.114.126:36373): Connection reset by peer (error 104)
2026-08-12T16:46:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:27 dist-test-slave-45dx krb5kdc[30326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:27 dist-test-slave-45dx krb5kdc[30326](info): set up 2 sockets
Aug 12 16:46:27 dist-test-slave-45dx krb5kdc[30326](info): commencing operation
krb5kdc: starting...
W20260812 16:46:28.990473 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:29 dist-test-slave-45dx krb5kdc[30326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:29.113463 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:39605
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:40873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:39605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:29.197121 30349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:29.197329 30349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:29.197352 30349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:29.198597 30349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:29.198642 30349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:29.198657 30349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:29.198669 30349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:29.198681 30349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:29.200241 30349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:40873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:39605
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:39605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:29.200511 30349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:29.200753 30349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:29.205682 30361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:29.205807 30349 server_base.cc:1034] running on GCE node
W20260812 16:46:29.205687 30359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:29.205698 30363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:29.206223 30349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:29.206544 30349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:29.207686 30349 hybrid_clock.cc:648] HybridClock initialized: now 1786553189207667 us; error 35 us; skew 500 ppm
Aug 12 16:46:29 dist-test-slave-45dx krb5kdc[30326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553189, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:29.210333 30349 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:29.210794 30349 webserver.cc:460] Webserver started at http://127.21.114.126:35285/ using document root <none> and password file <none>
I20260812 16:46:29.211037 30349 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:29.211103 30349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:29.211249 30349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:29.212412 30349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "175fed76db06455e9e7b6659daa4eab7"
format_stamp: "Formatted at 2026-08-12 16:46:29 on dist-test-slave-45dx"
server_key: "182e4147b321b5302c1f5165de8f6957"
server_key_iv: "aa3bb2a8ba6c9833af1bd8e561236e1c"
server_key_version: "encryptionkey@0"
I20260812 16:46:29.212805 30349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "175fed76db06455e9e7b6659daa4eab7"
format_stamp: "Formatted at 2026-08-12 16:46:29 on dist-test-slave-45dx"
server_key: "182e4147b321b5302c1f5165de8f6957"
server_key_iv: "aa3bb2a8ba6c9833af1bd8e561236e1c"
server_key_version: "encryptionkey@0"
I20260812 16:46:29.214141 30349 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:29.214866 30377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:29.215044 30349 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:46:29.215149 30349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "175fed76db06455e9e7b6659daa4eab7"
format_stamp: "Formatted at 2026-08-12 16:46:29 on dist-test-slave-45dx"
server_key: "182e4147b321b5302c1f5165de8f6957"
server_key_iv: "aa3bb2a8ba6c9833af1bd8e561236e1c"
server_key_version: "encryptionkey@0"
I20260812 16:46:29.215224 30349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:29.224237 30349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:29.226502 30349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:29.226655 30349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:29.230870 30349 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:39605
I20260812 16:46:29.230921 30485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:39605 every 8 connection(s)
I20260812 16:46:29.231276 30349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:29.232142 30487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:29.234483 30487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7: Bootstrap starting.
I20260812 16:46:29.235024 30487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:29.235266 30487 log.cc:824] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:29.235934 30487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7: No bootstrap required, opened a new log
I20260812 16:46:29.237524 30487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175fed76db06455e9e7b6659daa4eab7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39605 } }
I20260812 16:46:29.237663 30487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:29.237686 30487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 175fed76db06455e9e7b6659daa4eab7, State: Initialized, Role: FOLLOWER
I20260812 16:46:29.237793 30487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175fed76db06455e9e7b6659daa4eab7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39605 } }
I20260812 16:46:29.237875 30487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:29.237914 30487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:29.237967 30487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:29.238808 30487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175fed76db06455e9e7b6659daa4eab7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39605 } }
I20260812 16:46:29.238883 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30349
I20260812 16:46:29.238931 30487 leader_election.cc:302] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 175fed76db06455e9e7b6659daa4eab7; no voters:
I20260812 16:46:29.239024 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:29.239118 30487 leader_election.cc:288] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:29.239152 30490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:29.239229 21961 external_mini_cluster.cc:1428] Setting key 32046b6d990b9f1a06357b4ff4a5437d
I20260812 16:46:29.239331 30490 raft_consensus.cc:686] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [term 1 LEADER]: Becoming Leader. State: Replica: 175fed76db06455e9e7b6659daa4eab7, State: Running, Role: LEADER
I20260812 16:46:29.239408 30490 consensus_queue.cc:237] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175fed76db06455e9e7b6659daa4eab7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39605 } }
I20260812 16:46:29.239414 30487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:29.239991 30492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 175fed76db06455e9e7b6659daa4eab7. Latest consensus state: current_term: 1 leader_uuid: "175fed76db06455e9e7b6659daa4eab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175fed76db06455e9e7b6659daa4eab7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39605 } } }
I20260812 16:46:29.240218 30492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:29.240154 30491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "175fed76db06455e9e7b6659daa4eab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175fed76db06455e9e7b6659daa4eab7" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 39605 } } }
I20260812 16:46:29.240401 30491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:29.241176 30521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:29.241829 30521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:29.243435 30521 catalog_manager.cc:1347] Generated new cluster ID: 7d19933b8a9147b686eca6b90013f37e
I20260812 16:46:29.243489 30521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:29.245122 30501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:29.239833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49011 (local address 127.21.114.126:39605)
0812 16:46:29.240023 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:29.240032 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:29.240068 (+ 36us) server_negotiation.cc:407] Connection header received
0812 16:46:29.240203 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:29.240212 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:29.240279 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:29.240744 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:29.240869 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:29.242109 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:29.243096 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:29.243614 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:29.243732 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:29.244505 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:29.244508 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:29.244509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:29.244671 (+ 162us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:29.244703 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:29.244713 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:29.244806 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:29.244898 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 16:46:29.244930 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260812 16:46:29.249264 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:29.253597 30501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:29.250683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33471 (local address 127.21.114.126:39605)
0812 16:46:29.250724 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:29.250726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:29.250798 (+ 72us) server_negotiation.cc:407] Connection header received
0812 16:46:29.250872 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:29.250873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:29.250889 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:29.250939 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:29.251059 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:29.251566 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:29.252287 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:29.252548 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:29.252624 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:29.253328 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:29.253329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:29.253330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:29.253334 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:29.253350 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:29.253354 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:29.253402 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:29.253480 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 16:46:29.253494 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:46:29.279544 30521 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:29.280138 30521 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:29.287959 30521 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 175fed76db06455e9e7b6659daa4eab7: Generated new TSK 0
I20260812 16:46:29.288163 30521 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:29.293017 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30349
W20260812 16:46:29.308362 30324 connection.cc:535] client connection to 127.21.114.126:39605 recv error: Network error: failed to read from TLS socket (remote: 127.21.114.126:39605): Connection reset by peer (error 104)
2026-08-12T16:46:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1634 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:29 dist-test-slave-45dx krb5kdc[30552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:29 dist-test-slave-45dx krb5kdc[30552](info): set up 2 sockets
Aug 12 16:46:29 dist-test-slave-45dx krb5kdc[30552](info): commencing operation
krb5kdc: starting...
W20260812 16:46:30.606781 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:30 dist-test-slave-45dx krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:30.730528 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33527
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:46313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:30.813737 30572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:30.813984 30572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:30.814024 30572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:30.815167 30572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:30.815236 30572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:30.815263 30572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:30.815290 30572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:30.815315 30572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:30.816838 30572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:46313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33527
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:30.817111 30572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:30.817333 30572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:30.822199 30579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:30.822201 30583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:30.822381 30572 server_base.cc:1034] running on GCE node
W20260812 16:46:30.822254 30580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:30.822820 30572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:30.823115 30572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:30.824282 30572 hybrid_clock.cc:648] HybridClock initialized: now 1786553190824265 us; error 43 us; skew 500 ppm
Aug 12 16:46:30 dist-test-slave-45dx krb5kdc[30552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553190, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:30.826886 30572 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:30.827353 30572 webserver.cc:460] Webserver started at http://127.21.114.126:41035/ using document root <none> and password file <none>
I20260812 16:46:30.827577 30572 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:30.827642 30572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:30.827793 30572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:30.828958 30572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "45f7f31e65ed4876b36f226c9ea9355c"
format_stamp: "Formatted at 2026-08-12 16:46:30 on dist-test-slave-45dx"
server_key: "86bd6a39ae13367cdbb8934a41af1a83"
server_key_iv: "5386c136f009eac1c3d1a9c4feef6751"
server_key_version: "encryptionkey@0"
I20260812 16:46:30.829330 30572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "45f7f31e65ed4876b36f226c9ea9355c"
format_stamp: "Formatted at 2026-08-12 16:46:30 on dist-test-slave-45dx"
server_key: "86bd6a39ae13367cdbb8934a41af1a83"
server_key_iv: "5386c136f009eac1c3d1a9c4feef6751"
server_key_version: "encryptionkey@0"
I20260812 16:46:30.830665 30572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 16:46:30.831365 30593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:30.831535 30572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:30.831634 30572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "45f7f31e65ed4876b36f226c9ea9355c"
format_stamp: "Formatted at 2026-08-12 16:46:30 on dist-test-slave-45dx"
server_key: "86bd6a39ae13367cdbb8934a41af1a83"
server_key_iv: "5386c136f009eac1c3d1a9c4feef6751"
server_key_version: "encryptionkey@0"
I20260812 16:46:30.831712 30572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:30.835067 30572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:30.837356 30572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:30.837515 30572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:30.841504 30572 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33527
I20260812 16:46:30.841534 30696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33527 every 8 connection(s)
I20260812 16:46:30.841868 30572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:30.842823 30697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:30.845254 30697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c: Bootstrap starting.
I20260812 16:46:30.845402 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30572
I20260812 16:46:30.845537 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:30.845728 21961 external_mini_cluster.cc:1428] Setting key ac97401384391c56f192b9606b8530a9
I20260812 16:46:30.845952 30697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:30.846321 30697 log.cc:824] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:30.847121 30697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c: No bootstrap required, opened a new log
I20260812 16:46:30.848526 30701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:30.846289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45611 (local address 127.21.114.126:33527)
0812 16:46:30.846473 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:30.846483 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:30.846584 (+ 101us) server_negotiation.cc:407] Connection header received
0812 16:46:30.847227 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:30.847238 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:30.847277 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:30.847429 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:30.848071 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:30.848074 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:30.848075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:30.848079 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:30.848129 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:30.848142 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:30.848229 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:30.848262 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 16:46:30.848328 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260812 16:46:30.849654 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:30.849670 30697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f7f31e65ed4876b36f226c9ea9355c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33527 } }
I20260812 16:46:30.849830 30697 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:30.849869 30697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f7f31e65ed4876b36f226c9ea9355c, State: Initialized, Role: FOLLOWER
I20260812 16:46:30.849979 30697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f7f31e65ed4876b36f226c9ea9355c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33527 } }
I20260812 16:46:30.850060 30697 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:30.850090 30697 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:30.850144 30697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:30.850889 30697 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f7f31e65ed4876b36f226c9ea9355c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33527 } }
I20260812 16:46:30.851024 30697 leader_election.cc:302] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45f7f31e65ed4876b36f226c9ea9355c; no voters:
I20260812 16:46:30.851186 30697 leader_election.cc:288] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:30.851208 30708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:30.851426 30708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [term 1 LEADER]: Becoming Leader. State: Replica: 45f7f31e65ed4876b36f226c9ea9355c, State: Running, Role: LEADER
I20260812 16:46:30.851516 30697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:30.851557 30708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f7f31e65ed4876b36f226c9ea9355c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33527 } }
I20260812 16:46:30.851953 30715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45f7f31e65ed4876b36f226c9ea9355c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f7f31e65ed4876b36f226c9ea9355c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33527 } } }
I20260812 16:46:30.852066 30715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:30.852288 30730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:30.851953 30716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45f7f31e65ed4876b36f226c9ea9355c. Latest consensus state: current_term: 1 leader_uuid: "45f7f31e65ed4876b36f226c9ea9355c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f7f31e65ed4876b36f226c9ea9355c" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33527 } } }
I20260812 16:46:30.852770 30716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:30.853166 30730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:30.853258 30701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:30.851265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43875 (local address 127.21.114.126:33527)
0812 16:46:30.851306 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:30.851308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:30.852028 (+ 720us) server_negotiation.cc:407] Connection header received
0812 16:46:30.852141 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:30.852142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:30.852148 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:30.852178 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:30.852907 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:30.852908 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:30.852908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:30.852912 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:30.852928 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:30.852934 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:30.852967 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:30.853094 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 16:46:30.853107 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:46:30.854750 30730 catalog_manager.cc:1347] Generated new cluster ID: a34d8cd47fc14248b978be64209943db
I20260812 16:46:30.854802 30730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:30.862633 30730 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:30.862802 30730 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:30.873880 30730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45f7f31e65ed4876b36f226c9ea9355c: Generated new TSK 0
I20260812 16:46:30.874095 30730 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:30.880771 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30572
2026-08-12T16:46:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1585 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:30 dist-test-slave-45dx krb5kdc[30751](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:30 dist-test-slave-45dx krb5kdc[30751](info): set up 2 sockets
Aug 12 16:46:30 dist-test-slave-45dx krb5kdc[30751](info): commencing operation
krb5kdc: starting...
W20260812 16:46:32.193075 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:32 dist-test-slave-45dx krb5kdc[30751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:32.323412 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33565
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:32.407600 30775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:32.407867 30775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:32.407913 30775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:32.409164 30775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:32.409231 30775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:32.409255 30775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:32.409276 30775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:32.409323 30775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:32.410836 30775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:32.411110 30775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:32.411355 30775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:32.416321 30790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:32.416335 30781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:32.416383 30775 server_base.cc:1034] running on GCE node
W20260812 16:46:32.416378 30785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:32.416929 30775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:32.417246 30775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:32.418407 30775 hybrid_clock.cc:648] HybridClock initialized: now 1786553192418393 us; error 28 us; skew 500 ppm
Aug 12 16:46:32 dist-test-slave-45dx krb5kdc[30751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553192, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:32.420984 30775 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:32.421480 30775 webserver.cc:460] Webserver started at http://127.21.114.126:43569/ using document root <none> and password file <none>
I20260812 16:46:32.421741 30775 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:32.421809 30775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:32.421953 30775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:32.423043 30775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "bac698d14c25424483e8ae05181b0fd1"
format_stamp: "Formatted at 2026-08-12 16:46:32 on dist-test-slave-45dx"
server_key: "8fd99741551b935ba0d0596ba781970d"
server_key_iv: "28b9493570277983f45ab46257e53058"
server_key_version: "encryptionkey@0"
I20260812 16:46:32.423421 30775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "bac698d14c25424483e8ae05181b0fd1"
format_stamp: "Formatted at 2026-08-12 16:46:32 on dist-test-slave-45dx"
server_key: "8fd99741551b935ba0d0596ba781970d"
server_key_iv: "28b9493570277983f45ab46257e53058"
server_key_version: "encryptionkey@0"
I20260812 16:46:32.424856 30775 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:46:32.425642 30810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:32.425815 30775 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 16:46:32.425920 30775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "bac698d14c25424483e8ae05181b0fd1"
format_stamp: "Formatted at 2026-08-12 16:46:32 on dist-test-slave-45dx"
server_key: "8fd99741551b935ba0d0596ba781970d"
server_key_iv: "28b9493570277983f45ab46257e53058"
server_key_version: "encryptionkey@0"
I20260812 16:46:32.425998 30775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:32.439811 30775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:32.441821 30775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:32.441991 30775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:32.446278 30775 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33565
I20260812 16:46:32.446314 30904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33565 every 8 connection(s)
I20260812 16:46:32.446677 30775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:32.447595 30905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:32.448971 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30775
I20260812 16:46:32.449105 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:32.449313 21961 external_mini_cluster.cc:1428] Setting key a5f3bd6b7f31b9718afa73418dabbd27
I20260812 16:46:32.450510 30905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1: Bootstrap starting.
I20260812 16:46:32.451313 30905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:32.451676 30905 log.cc:824] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:32.452672 30905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1: No bootstrap required, opened a new log
I20260812 16:46:32.455483 30905 raft_consensus.cc:348] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac698d14c25424483e8ae05181b0fd1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33565 } }
I20260812 16:46:32.455699 30905 raft_consensus.cc:374] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:32.455778 30905 raft_consensus.cc:729] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac698d14c25424483e8ae05181b0fd1, State: Initialized, Role: FOLLOWER
I20260812 16:46:32.455925 30905 consensus_queue.cc:260] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac698d14c25424483e8ae05181b0fd1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33565 } }
I20260812 16:46:32.456027 30905 raft_consensus.cc:388] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:32.456087 30905 raft_consensus.cc:482] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:32.456152 30905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 16:46:32 dist-test-slave-45dx krb5kdc[30751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:32.456895 30905 raft_consensus.cc:504] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac698d14c25424483e8ae05181b0fd1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33565 } }
I20260812 16:46:32.457026 30905 leader_election.cc:302] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bac698d14c25424483e8ae05181b0fd1; no voters:
I20260812 16:46:32.457228 30905 leader_election.cc:288] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:32.457273 30912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:32.457476 30912 raft_consensus.cc:686] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [term 1 LEADER]: Becoming Leader. State: Replica: bac698d14c25424483e8ae05181b0fd1, State: Running, Role: LEADER
I20260812 16:46:32.457543 30905 sys_catalog.cc:564] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:32.457873 30912 consensus_queue.cc:237] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac698d14c25424483e8ae05181b0fd1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33565 } }
I20260812 16:46:32.458571 30912 sys_catalog.cc:455] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bac698d14c25424483e8ae05181b0fd1. Latest consensus state: current_term: 1 leader_uuid: "bac698d14c25424483e8ae05181b0fd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac698d14c25424483e8ae05181b0fd1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33565 } } }
I20260812 16:46:32.458665 30912 sys_catalog.cc:458] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:32.459439 30913 sys_catalog.cc:455] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bac698d14c25424483e8ae05181b0fd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac698d14c25424483e8ae05181b0fd1" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33565 } } }
I20260812 16:46:32.459578 30913 sys_catalog.cc:458] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1 [sys.catalog]: This master's current role is: LEADER
W20260812 16:46:32.459638 30938 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:32.459724 30938 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:32.460148 30925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:32.460388 30925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:32.461575 30910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:32.449871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59271 (local address 127.21.114.126:33565)
0812 16:46:32.450054 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:32.450063 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:32.450095 (+ 32us) server_negotiation.cc:407] Connection header received
0812 16:46:32.450513 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:32.450520 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:32.450567 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:32.450729 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:32.451565 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:32.452596 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:32.453757 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:32.454180 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:32.454260 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:32.457283 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:32.457288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:32.457288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:32.457302 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:32.459646 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:32.460099 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:32.460103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:32.460103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:32.460223 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:32.460521 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:32.460522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:32.460522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:32.460856 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:32.461055 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:32.461174 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 16:46:32.461356 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260812 16:46:32.462296 30925 catalog_manager.cc:1347] Generated new cluster ID: 59b76d315c6d499996982890a2c280c0
I20260812 16:46:32.462355 30925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:32.462716 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:32.474532 30925 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:32.475279 30925 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:32.479147 30925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bac698d14c25424483e8ae05181b0fd1: Generated new TSK 0
I20260812 16:46:32.479351 30925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:32.479952 30910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:32.464253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44539 (local address 127.21.114.126:33565)
0812 16:46:32.472140 (+ 7887us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:32.472142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:32.472153 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:32.472184 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:32.472185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:32.472224 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:32.472296 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:32.473045 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:32.473823 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:32.474864 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:32.475228 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:32.475307 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:32.476889 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:32.476890 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:32.476890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:32.476899 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:32.478609 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:32.479051 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:32.479052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:32.479053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:32.479127 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:32.479397 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:32.479398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:32.479398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:32.479545 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:32.479641 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:32.479812 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 16:46:32.479890 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7836}
I20260812 16:46:32.481952 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30775
2026-08-12T16:46:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:32 dist-test-slave-45dx krb5kdc[30964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:32 dist-test-slave-45dx krb5kdc[30964](info): set up 2 sockets
Aug 12 16:46:32 dist-test-slave-45dx krb5kdc[30964](info): commencing operation
krb5kdc: starting...
W20260812 16:46:33.800534 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:33 dist-test-slave-45dx krb5kdc[30964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:33.924710 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33433
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:33433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:34.008802 30984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:34.009014 30984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:34.009037 30984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:34.010304 30984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:34.010350 30984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:34.010365 30984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:34.010413 30984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:34.010439 30984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:34.011929 30984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:33433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:33433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:34.012180 30984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:34.012437 30984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:34.017464 30995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:34.017520 30984 server_base.cc:1034] running on GCE node
W20260812 16:46:34.017484 30998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:34.017518 30996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:34.017952 30984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:34.018253 30984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:34.019419 30984 hybrid_clock.cc:648] HybridClock initialized: now 1786553194019403 us; error 40 us; skew 500 ppm
Aug 12 16:46:34 dist-test-slave-45dx krb5kdc[30964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553194, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:34.027891 30984 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:34.028474 30984 webserver.cc:460] Webserver started at http://127.21.114.126:41741/ using document root <none> and password file <none>
I20260812 16:46:34.028733 30984 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:34.028800 30984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:34.028950 30984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:34.030015 30984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "45ba47a38aa747379ef66d8859dfad9e"
format_stamp: "Formatted at 2026-08-12 16:46:34 on dist-test-slave-45dx"
server_key: "2d44e1e8d84791ba5f273f6f561cecb7"
server_key_iv: "a2522b3fc444ca7f696d89549354ca05"
server_key_version: "encryptionkey@0"
I20260812 16:46:34.030377 30984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "45ba47a38aa747379ef66d8859dfad9e"
format_stamp: "Formatted at 2026-08-12 16:46:34 on dist-test-slave-45dx"
server_key: "2d44e1e8d84791ba5f273f6f561cecb7"
server_key_iv: "a2522b3fc444ca7f696d89549354ca05"
server_key_version: "encryptionkey@0"
I20260812 16:46:34.031746 30984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:46:34.032552 31009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:34.032727 30984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:34.032831 30984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "45ba47a38aa747379ef66d8859dfad9e"
format_stamp: "Formatted at 2026-08-12 16:46:34 on dist-test-slave-45dx"
server_key: "2d44e1e8d84791ba5f273f6f561cecb7"
server_key_iv: "a2522b3fc444ca7f696d89549354ca05"
server_key_version: "encryptionkey@0"
I20260812 16:46:34.032910 30984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:34.040949 30984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:34.043366 30984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:34.043536 30984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:34.047850 30984 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:33433
I20260812 16:46:34.047890 31113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:33433 every 8 connection(s)
I20260812 16:46:34.048239 30984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:34.049127 31114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:34.050166 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 30984
I20260812 16:46:34.050316 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:34.050515 21961 external_mini_cluster.cc:1428] Setting key 076ecbc2f26dbb90750d15457c36c69d
I20260812 16:46:34.051999 31114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e: Bootstrap starting.
I20260812 16:46:34.052709 31114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:34.053002 31114 log.cc:824] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:34.053673 31114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e: No bootstrap required, opened a new log
I20260812 16:46:34.055450 31114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ba47a38aa747379ef66d8859dfad9e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33433 } }
I20260812 16:46:34.055620 31114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:34.055667 31114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ba47a38aa747379ef66d8859dfad9e, State: Initialized, Role: FOLLOWER
I20260812 16:46:34.055796 31114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ba47a38aa747379ef66d8859dfad9e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33433 } }
I20260812 16:46:34.055873 31114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:34.055931 31114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:34.055986 31114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:34.056211 31120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:34.051057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49833 (local address 127.21.114.126:33433)
0812 16:46:34.051233 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:34.051241 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:34.051267 (+ 26us) server_negotiation.cc:407] Connection header received
0812 16:46:34.051787 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:34.051793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:34.051840 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:34.051972 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:34.052221 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:34.053270 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:34.054142 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:34.054589 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:34.054712 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:34.055396 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:34.055400 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:34.055400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:34.055580 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:34.055624 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:34.055634 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:34.055926 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:34.055963 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 16:46:34.056037 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260812 16:46:34.056660 31114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ba47a38aa747379ef66d8859dfad9e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33433 } }
I20260812 16:46:34.056767 31114 leader_election.cc:302] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45ba47a38aa747379ef66d8859dfad9e; no voters:
I20260812 16:46:34.056926 31114 leader_election.cc:288] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:34.056979 31123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:34.057178 31123 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [term 1 LEADER]: Becoming Leader. State: Replica: 45ba47a38aa747379ef66d8859dfad9e, State: Running, Role: LEADER
I20260812 16:46:34.057200 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:34.057245 31114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:34.057318 31123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ba47a38aa747379ef66d8859dfad9e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33433 } }
I20260812 16:46:34.057686 31124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45ba47a38aa747379ef66d8859dfad9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ba47a38aa747379ef66d8859dfad9e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33433 } } }
I20260812 16:46:34.057762 31124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:34.057937 31129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45ba47a38aa747379ef66d8859dfad9e. Latest consensus state: current_term: 1 leader_uuid: "45ba47a38aa747379ef66d8859dfad9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ba47a38aa747379ef66d8859dfad9e" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 33433 } } }
I20260812 16:46:34.058003 31129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:34.058346 31147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:34.059000 31147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:34.060714 31147 catalog_manager.cc:1347] Generated new cluster ID: 7ba1f44d693641e692c475bb60394e52
I20260812 16:46:34.060760 31147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:34.062593 31120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:34.058833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45207 (local address 127.21.114.126:33433)
0812 16:46:34.058892 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:34.058895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:34.059004 (+ 109us) server_negotiation.cc:407] Connection header received
0812 16:46:34.059103 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:34.059104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:34.059115 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:34.059146 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:34.059545 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:34.060254 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:34.061291 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:34.061590 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:34.061662 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:34.062352 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:34.062353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:34.062354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:34.062358 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:34.062375 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:34.062379 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:34.062439 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:34.062496 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 16:46:34.062521 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 16:46:34.072033 31147 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:34.072626 31147 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:34.077272 31147 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45ba47a38aa747379ef66d8859dfad9e: Generated new TSK 0
I20260812 16:46:34.077476 31147 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:34.080404 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 30984
2026-08-12T16:46:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1587 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:34 dist-test-slave-45dx krb5kdc[31175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:34 dist-test-slave-45dx krb5kdc[31175](info): set up 2 sockets
Aug 12 16:46:34 dist-test-slave-45dx krb5kdc[31175](info): commencing operation
krb5kdc: starting...
W20260812 16:46:35.386605 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:35 dist-test-slave-45dx krb5kdc[31175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:35.514674 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42617
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:42617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:35.597985 31197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:35.598237 31197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:35.598278 31197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:35.599455 31197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:35.599525 31197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:35.599550 31197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:35.599570 31197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:35.599599 31197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:35.601136 31197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:42617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:42617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:35.601426 31197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:35.601667 31197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:35.606705 31212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:35.606717 31206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:35.606721 31209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:35.606837 31197 server_base.cc:1034] running on GCE node
I20260812 16:46:35.607203 31197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:35.607550 31197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:35.608692 31197 hybrid_clock.cc:648] HybridClock initialized: now 1786553195608677 us; error 30 us; skew 500 ppm
Aug 12 16:46:35 dist-test-slave-45dx krb5kdc[31175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553195, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:35.611208 31197 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:35.611604 31197 webserver.cc:460] Webserver started at http://127.21.114.126:38199/ using document root <none> and password file <none>
I20260812 16:46:35.611810 31197 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:35.611852 31197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:35.611946 31197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:35.613071 31197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "2bf5ddd221f64487a9ee7ef74381690d"
format_stamp: "Formatted at 2026-08-12 16:46:35 on dist-test-slave-45dx"
server_key: "b65c7b2b351d24197ae575bdda20f3bf"
server_key_iv: "79b41f633fa4ed78c705f9cacf32d9be"
server_key_version: "encryptionkey@0"
I20260812 16:46:35.613402 31197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "2bf5ddd221f64487a9ee7ef74381690d"
format_stamp: "Formatted at 2026-08-12 16:46:35 on dist-test-slave-45dx"
server_key: "b65c7b2b351d24197ae575bdda20f3bf"
server_key_iv: "79b41f633fa4ed78c705f9cacf32d9be"
server_key_version: "encryptionkey@0"
I20260812 16:46:35.614718 31197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:35.615453 31221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:35.615640 31197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 16:46:35.615732 31197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "2bf5ddd221f64487a9ee7ef74381690d"
format_stamp: "Formatted at 2026-08-12 16:46:35 on dist-test-slave-45dx"
server_key: "b65c7b2b351d24197ae575bdda20f3bf"
server_key_iv: "79b41f633fa4ed78c705f9cacf32d9be"
server_key_version: "encryptionkey@0"
I20260812 16:46:35.615792 31197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:35.620556 31197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:35.622510 31197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:35.622625 31197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:35.626560 31197 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:42617
I20260812 16:46:35.626628 31321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:42617 every 8 connection(s)
I20260812 16:46:35.626959 31197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:35.627982 31323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:35.629735 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31197
I20260812 16:46:35.629853 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:35.630033 21961 external_mini_cluster.cc:1428] Setting key 9c7651011f370e3350cf5f97f00ad995
I20260812 16:46:35.630672 31323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d: Bootstrap starting.
I20260812 16:46:35.631433 31323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:35.631767 31323 log.cc:824] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:35.632725 31323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d: No bootstrap required, opened a new log
I20260812 16:46:35.632916 31328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:35.630587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50077 (local address 127.21.114.126:42617)
0812 16:46:35.630788 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:35.630797 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:35.630831 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:46:35.631456 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:35.631466 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:35.631503 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:35.631670 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:35.632349 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:35.632353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:35.632353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:35.632358 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:35.632410 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:35.632421 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:35.632493 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:35.632573 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 16:46:35.632623 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260812 16:46:35.633955 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:35.635049 31323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bf5ddd221f64487a9ee7ef74381690d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42617 } }
I20260812 16:46:35.635213 31323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 16:46:35.635262 31323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf5ddd221f64487a9ee7ef74381690d, State: Initialized, Role: FOLLOWER
I20260812 16:46:35.635385 31323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bf5ddd221f64487a9ee7ef74381690d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42617 } }
I20260812 16:46:35.635491 31323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 16:46:35.635543 31323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 16:46:35.635634 31323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:35.636436 31323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bf5ddd221f64487a9ee7ef74381690d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42617 } }
I20260812 16:46:35.636518 31328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:35.635391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44721 (local address 127.21.114.126:42617)
0812 16:46:35.635431 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:35.635433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:35.635560 (+ 127us) server_negotiation.cc:407] Connection header received
0812 16:46:35.635626 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:35.635627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:35.635633 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:35.635690 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:35.636253 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:35.636254 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:35.636255 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 16:46:35.636259 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:35.636272 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 16:46:35.636276 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:35.636348 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:35.636437 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 16:46:35.636451 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:35.636575 31323 leader_election.cc:302] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bf5ddd221f64487a9ee7ef74381690d; no voters:
I20260812 16:46:35.636754 31323 leader_election.cc:288] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 16:46:35.636777 31346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:35.636968 31346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [term 1 LEADER]: Becoming Leader. State: Replica: 2bf5ddd221f64487a9ee7ef74381690d, State: Running, Role: LEADER
I20260812 16:46:35.637071 31323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:35.637087 31346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bf5ddd221f64487a9ee7ef74381690d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42617 } }
I20260812 16:46:35.637465 31348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bf5ddd221f64487a9ee7ef74381690d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bf5ddd221f64487a9ee7ef74381690d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42617 } } }
I20260812 16:46:35.637568 31348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:35.637784 31360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:35.637789 31351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bf5ddd221f64487a9ee7ef74381690d. Latest consensus state: current_term: 1 leader_uuid: "2bf5ddd221f64487a9ee7ef74381690d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bf5ddd221f64487a9ee7ef74381690d" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 42617 } } }
I20260812 16:46:35.637918 31351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:35.638382 31360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:35.639851 31360 catalog_manager.cc:1347] Generated new cluster ID: d029bb6e2be54d8396263e0010a5a4d9
I20260812 16:46:35.639894 31360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:35.649269 31360 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:35.649437 31360 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:35.659216 31360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bf5ddd221f64487a9ee7ef74381690d: Generated new TSK 0
I20260812 16:46:35.659442 31360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:35.666277 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31197
2026-08-12T16:46:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1590 ms)
[----------] 18 tests from AuthTokenIssuingTest (28988 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:35 dist-test-slave-45dx krb5kdc[31391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:35 dist-test-slave-45dx krb5kdc[31391](info): set up 2 sockets
Aug 12 16:46:35 dist-test-slave-45dx krb5kdc[31391](info): commencing operation
krb5kdc: starting...
W20260812 16:46:36.989586 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:37.115403 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:45783
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:45783,127.21.114.125:45633,127.21.114.124:40807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:37.197731 31414 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 16:46:37.198001 31414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:37.198033 31414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:37.198076 31414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:37.199234 31414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:37.199306 31414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:37.199328 31414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:37.199347 31414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:37.199366 31414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:37.200898 31414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:45783,127.21.114.125:45633,127.21.114.124:40807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:45783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:37.201179 31414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:37.201416 31414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 16:46:37.206436 31414 server_base.cc:1034] running on GCE node
W20260812 16:46:37.206385 31424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:37.206384 31431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:37.206373 31425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:37.206888 31414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:37.207178 31414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:37.208398 31414 hybrid_clock.cc:648] HybridClock initialized: now 1786553197208376 us; error 41 us; skew 500 ppm
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:37.210989 31414 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:37.211442 31414 webserver.cc:460] Webserver started at http://127.21.114.126:40879/ using document root <none> and password file <none>
I20260812 16:46:37.211630 31414 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:37.211671 31414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:37.211761 31414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:37.212860 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "20affd942d7c4a04916e4d1aa20a02cd"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "1c8a1cbfc3eb11edf7561f7fdc486596"
server_key_iv: "23a19dc91f304352ea6d3fa416a1c219"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.213176 31414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "20affd942d7c4a04916e4d1aa20a02cd"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "1c8a1cbfc3eb11edf7561f7fdc486596"
server_key_iv: "23a19dc91f304352ea6d3fa416a1c219"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.214453 31414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 16:46:37.215144 31441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:37.215324 31414 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:37.215425 31414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "20affd942d7c4a04916e4d1aa20a02cd"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "1c8a1cbfc3eb11edf7561f7fdc486596"
server_key_iv: "23a19dc91f304352ea6d3fa416a1c219"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.215482 31414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:37.225556 31414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:37.227315 31414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:37.227432 31414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:37.231313 31414 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:45783
I20260812 16:46:37.231367 31540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:45783 every 8 connection(s)
I20260812 16:46:37.231706 31414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:37.232672 31541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:37.234186 31541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.240167 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31414
I20260812 16:46:37.240286 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:37.240512 21961 external_mini_cluster.cc:1428] Setting key 36a03695e9c13bc7dd7c3555f6624fbc
I20260812 16:46:37.244244 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.234936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56526 (local address 127.21.114.126:45783)
0812 16:46:37.235115 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.235119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.235213 (+ 94us) server_negotiation.cc:407] Connection header received
0812 16:46:37.235903 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.235906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.235926 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.236037 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.236640 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.237443 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.238379 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.238685 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.238798 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.240902 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.240910 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.240911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.240919 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.242679 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.243145 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.243147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.243147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.243227 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.243488 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.243488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.243489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.243690 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.243753 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.243991 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.244088 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":108,"threads_started":1}
I20260812 16:46:37.244421 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.234879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:45783 (local address 127.0.0.1:56526)
0812 16:46:37.235057 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.235104 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.235737 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.236045 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.236047 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.236374 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.236538 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.236543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.237545 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.237547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.238274 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.238276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.238766 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.238768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.238841 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.239307 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.239315 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.240813 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.242765 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.242772 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.242775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.243057 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.243296 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.243296 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.243297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.243421 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.243764 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.243771 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.243848 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.243949 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.244198 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":77,"thread_start_us":83,"threads_started":1}
I20260812 16:46:37.245270 31541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.245676 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.245535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55026)
0812 16:46:37.245588 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.245645 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 16:46:37.245826 31446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
I20260812 16:46:37.246315 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.246188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55040)
0812 16:46:37.246246 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.246281 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 16:46:37.246439 31541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:45633: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.21.114.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab.
Entry for principal kudu/127.21.114.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab.
I20260812 16:46:37.267508 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:45633
--webserver_interface=127.21.114.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab
--principal=kudu/127.21.114.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:45783,127.21.114.125:45633,127.21.114.124:40807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:46:37.295699 31541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } attempt: 1
I20260812 16:46:37.296267 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.296102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55054)
0812 16:46:37.296181 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.296229 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 16:46:37.296653 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.296556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55062)
0812 16:46:37.296600 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.296629 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 16:46:37.296752 31541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:45633: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
W20260812 16:46:37.351521 31557 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 16:46:37.351737 31557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:37.351756 31557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:37.351776 31557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:37.352972 31557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:37.353015 31557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:37.353029 31557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:37.353042 31557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:37.353055 31557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:37.354461 31557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:45783,127.21.114.125:45633,127.21.114.124:40807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab
--principal=kudu/127.21.114.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:45633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.114.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:37.354660 31557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:37.354827 31557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:37.359577 31565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:37.359602 31568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:37.359604 31564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:37.359928 31557 server_base.cc:1034] running on GCE node
I20260812 16:46:37.360178 31557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:37.360531 31557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:37.361675 31557 hybrid_clock.cc:648] HybridClock initialized: now 1786553197361653 us; error 38 us; skew 500 ppm
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:37.364111 31557 init.cc:377] Logged in from keytab as kudu/127.21.114.125@KRBTEST.COM (short username kudu)
I20260812 16:46:37.364609 31557 webserver.cc:460] Webserver started at http://127.21.114.125:44583/ using document root <none> and password file <none>
I20260812 16:46:37.364893 31557 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:37.364887 31541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } attempt: 2
I20260812 16:46:37.364961 31557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:37.365093 31557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:37.365257 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.365128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55064)
0812 16:46:37.365190 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.365226 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 16:46:37.365624 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.365525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55068)
0812 16:46:37.365571 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.365596 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 16:46:37.365718 31541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:45633: Network error: Client connection negotiation failed: client connection to 127.21.114.125:45633: connect: Connection refused (error 111)
I20260812 16:46:37.366302 31557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data/instance:
uuid: "3d9a1776b3ef4866b447ca89e682b579"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "8ce1a17eaa0626ae6a801126f3ae47df"
server_key_iv: "2cc6f981e194c54f6550a2846bae3046"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.366675 31557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal/instance:
uuid: "3d9a1776b3ef4866b447ca89e682b579"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "8ce1a17eaa0626ae6a801126f3ae47df"
server_key_iv: "2cc6f981e194c54f6550a2846bae3046"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.368006 31557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:37.368827 31588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:37.369007 31557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:37.369110 31557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal
uuid: "3d9a1776b3ef4866b447ca89e682b579"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "8ce1a17eaa0626ae6a801126f3ae47df"
server_key_iv: "2cc6f981e194c54f6550a2846bae3046"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.369194 31557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:37.395609 31557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:37.397684 31557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:37.397878 31557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:37.402117 31557 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.125:45633
I20260812 16:46:37.402155 31689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.125:45633 every 8 connection(s)
I20260812 16:46:37.402550 31557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
I20260812 16:46:37.403463 31690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:37.405119 31690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:37.412554 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31557
I20260812 16:46:37.412674 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-1/wal/instance
I20260812 16:46:37.412878 21961 external_mini_cluster.cc:1428] Setting key a6cb8b54802c0c8440aa3b0cd9846df5
I20260812 16:46:37.413763 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.405794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:45783 (local address 127.0.0.1:56542)
0812 16:46:37.405987 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.406030 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.406490 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.406695 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.406698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.406950 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.407142 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.407146 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.407795 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.407796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.408585 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.408587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.408949 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.408950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.409049 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.409503 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.409511 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.410820 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.412283 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.412289 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.412291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.412540 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.412786 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.412787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.412787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.412896 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.413261 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.413266 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.413400 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.413484 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.413607 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260812 16:46:37.413779 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.405895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.21.114.126:45783)
0812 16:46:37.405964 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.405966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.406115 (+ 149us) server_negotiation.cc:407] Connection header received
0812 16:46:37.406573 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.406574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.406585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.406642 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.407219 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.407715 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.408658 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.408873 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.408931 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.410914 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.410915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.410916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.410922 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.412210 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.412619 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.412621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.412621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.412696 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.413031 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.413033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.413033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.413191 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.413267 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.413535 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.413635 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 16:46:37.414364 31690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.114.124@KRBTEST.COM; defaulting to no policy
I20260812 16:46:37.422320 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.414641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55074)
0812 16:46:37.414729 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.414741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.414782 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.415052 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.415053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.415167 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.415215 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.415216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.416505 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.416506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.416991 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.416993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.417549 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.417551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.417648 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.418063 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.418069 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.419432 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.421239 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.421240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.421241 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.421416 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.421637 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.421637 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.421638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.421699 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.422004 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.422005 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.422042 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.422103 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.422203 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 16:46:37.422403 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.414703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.21.114.125:45633)
0812 16:46:37.414894 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.414899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.414922 (+ 23us) server_negotiation.cc:407] Connection header received
0812 16:46:37.414943 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.414946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.414960 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.415033 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.415293 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.416407 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.417084 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.417411 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.417546 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.419527 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.419535 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.419535 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.419542 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.421134 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.421509 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.421513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.421513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.421571 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.421786 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.421787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.421787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.421935 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.422025 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.422141 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.422257 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":162,"thread_start_us":84,"threads_started":1}
I20260812 16:46:37.423266 31690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.423697 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.423551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51118)
0812 16:46:37.423605 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.423659 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 16:46:37.423848 31590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
I20260812 16:46:37.424388 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.424220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51132)
0812 16:46:37.424331 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.424360 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 16:46:37.424512 31690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40807: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab.
Entry for principal kudu/127.21.114.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab.
I20260812 16:46:37.441638 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:40807
--webserver_interface=127.21.114.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab
--principal=kudu/127.21.114.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:45783,127.21.114.125:45633,127.21.114.124:40807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:46:37.456853 31541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } attempt: 3
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:46:37.464342 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.457212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55086)
0812 16:46:37.457277 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.457291 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.457366 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.457527 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.457528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.457692 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.457758 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.457760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.458432 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.458434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.458975 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.458977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.459377 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.459379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.459466 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.460013 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.460019 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.461516 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.463212 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.463214 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.463214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.463407 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.463634 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.463635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.463635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.463704 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.463963 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.463964 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.464016 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.464108 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.464215 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 16:46:37.464342 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.457297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55086 (local address 127.21.114.125:45633)
0812 16:46:37.457370 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.457372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.457382 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:46:37.457426 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.457427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.457447 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.457507 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.457844 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.458338 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.459074 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.459302 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.459380 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.461607 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.461609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.461609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.461618 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.463095 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.463497 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.463499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.463499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.463563 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.463770 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.463771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.463771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.463893 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.463970 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.464135 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.464215 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 16:46:37.464908 31541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.465302 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.465186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51138)
0812 16:46:37.465241 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.465275 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 16:46:37.465670 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.465584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51140)
0812 16:46:37.465630 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.465654 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 16:46:37.465812 31541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40807: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
I20260812 16:46:37.473713 31690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } attempt: 1
I20260812 16:46:37.474052 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.473944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51156)
0812 16:46:37.473998 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.474030 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 16:46:37.474428 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.474341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51172)
0812 16:46:37.474388 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.474412 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 16:46:37.474534 31690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40807: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
I20260812 16:46:37.496950 31541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } attempt: 1
I20260812 16:46:37.497409 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.497267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51178)
0812 16:46:37.497332 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.497371 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 16:46:37.497754 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.497659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51186)
0812 16:46:37.497704 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.497728 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 16:46:37.497845 31541 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40807: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
W20260812 16:46:37.526682 31705 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 16:46:37.526886 31705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:37.526903 31705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:37.526922 31705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:37.528093 31705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:37.528137 31705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:37.528151 31705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:37.528205 31705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:37.528231 31705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:37.529764 31705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:45783,127.21.114.125:45633,127.21.114.124:40807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab
--principal=kudu/127.21.114.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:40807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.114.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:37.530030 31705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:37.530293 31705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:37.535203 31731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:37.535280 31715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:37.535228 31721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:37.535565 31705 server_base.cc:1034] running on GCE node
I20260812 16:46:37.535813 31705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:37.536059 31705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:37.537196 31705 hybrid_clock.cc:648] HybridClock initialized: now 1786553197537185 us; error 28 us; skew 500 ppm
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:37.539644 31705 init.cc:377] Logged in from keytab as kudu/127.21.114.124@KRBTEST.COM (short username kudu)
I20260812 16:46:37.540019 31705 webserver.cc:460] Webserver started at http://127.21.114.124:38019/ using document root <none> and password file <none>
I20260812 16:46:37.540215 31705 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:37.540254 31705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:37.540421 31705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:37.541429 31705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data/instance:
uuid: "4e68f1b414c444aa95d57cdc216c6db8"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "2aef2f78cbbcd216b4a7312abbc022d1"
server_key_iv: "5bc211c4f4554f243b6cfddbcf404c5c"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.541755 31705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal/instance:
uuid: "4e68f1b414c444aa95d57cdc216c6db8"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "2aef2f78cbbcd216b4a7312abbc022d1"
server_key_iv: "5bc211c4f4554f243b6cfddbcf404c5c"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.542694 31690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } attempt: 2
I20260812 16:46:37.543079 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.542953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51188)
0812 16:46:37.543020 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.543051 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 16:46:37.543160 31705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 16:46:37.543468 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.543368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51192)
0812 16:46:37.543419 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.543445 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 16:46:37.543562 31690 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:40807: Network error: Client connection negotiation failed: client connection to 127.21.114.124:40807: connect: Connection refused (error 111)
I20260812 16:46:37.544020 31753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:37.544199 31705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:37.544294 31705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal
uuid: "4e68f1b414c444aa95d57cdc216c6db8"
format_stamp: "Formatted at 2026-08-12 16:46:37 on dist-test-slave-45dx"
server_key: "2aef2f78cbbcd216b4a7312abbc022d1"
server_key_iv: "5bc211c4f4554f243b6cfddbcf404c5c"
server_key_version: "encryptionkey@0"
I20260812 16:46:37.544395 31705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:37.558145 31705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:37.560518 31705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:37.560681 31705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:37.564661 31705 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.124:40807
I20260812 16:46:37.564690 31853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.124:40807 every 8 connection(s)
I20260812 16:46:37.565076 31705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
I20260812 16:46:37.565950 31855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:37.567154 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 31705
I20260812 16:46:37.567256 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786552916613187-21961-0/minicluster-data/master-2/wal/instance
I20260812 16:46:37.567492 21961 external_mini_cluster.cc:1428] Setting key 00c50552e196f83c9e8d1b0091ea08fb
I20260812 16:46:37.567775 31855 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.572989 31541 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } attempt: 2
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:46:37.578419 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.568579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56544 (local address 127.21.114.126:45783)
0812 16:46:37.568628 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.568630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.568801 (+ 171us) server_negotiation.cc:407] Connection header received
0812 16:46:37.569082 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.569083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.569097 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.569176 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.569717 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.570201 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.571254 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.571557 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.571635 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.574949 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.574950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.574951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.574958 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.576759 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.577294 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.577296 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.577296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.577357 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.577652 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.577653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.577654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.577792 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.577881 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.578236 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.578318 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 16:46:37.578610 31867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.568476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:45783 (local address 127.0.0.1:56544)
0812 16:46:37.568653 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.568696 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.568961 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.569206 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.569208 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.569467 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.569624 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.569628 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.570278 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.570278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.571174 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.571176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.571649 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.571650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.571787 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.572531 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.572539 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.574818 (+ 2279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.576854 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.576860 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.576863 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.577211 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.577437 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.577438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.577438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.577577 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.577891 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.577906 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.578071 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.578193 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.578356 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
I20260812 16:46:37.579226 31855 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.579308 31864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.568032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51200 (local address 127.21.114.124:40807)
0812 16:46:37.568233 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.568244 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.568286 (+ 42us) server_negotiation.cc:407] Connection header received
0812 16:46:37.568959 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.568968 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.568993 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.569085 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.569781 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.570743 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.571652 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.572114 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.572193 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.574870 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.574877 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.574877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.574891 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.577056 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.577501 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.577504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.577505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.577576 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.578072 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.578073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.578074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.578501 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.579039 (+ 538us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.579090 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.579167 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260812 16:46:37.581290 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.573292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51212)
0812 16:46:37.573341 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.573352 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.573392 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.573609 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.573610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.573752 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.573782 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.573783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.574469 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.574470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.575084 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.575087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.575472 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.575473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.575534 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.575869 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.575875 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.577337 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.580155 (+ 2818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.580156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.580156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.580412 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.580618 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.580619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.580620 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.580688 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.580968 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.580969 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.581014 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.581082 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.581170 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 16:46:37.581329 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.573321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51212 (local address 127.21.114.124:40807)
0812 16:46:37.573479 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.573480 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.573487 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:46:37.573513 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.573513 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.573529 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.573604 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.573858 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.574401 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.575175 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.575376 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.575467 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.577432 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.577434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.577434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.577440 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.580085 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.580488 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.580489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.580489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.580554 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.580759 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.580760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.580761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.580897 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.580965 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.581124 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.581203 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260812 16:46:37.583192 31541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd: Bootstrap starting.
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:46:37.584043 31541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:37.584442 31541 log.cc:824] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd: Log is configured to *not* fsync() on all Append() calls
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:37.585624 31541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd: No bootstrap required, opened a new log
I20260812 16:46:37.587360 31541 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.587607 31541 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20affd942d7c4a04916e4d1aa20a02cd, State: Initialized, Role: FOLLOWER
I20260812 16:46:37.587647 31867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.579529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:45633 (local address 127.0.0.1:55094)
0812 16:46:37.579870 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.579881 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.579943 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.580254 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.580255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.580443 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.580482 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.580483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.581277 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.581278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.582058 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.582061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.582591 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.582592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.582635 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.583180 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.583185 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.584397 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.586309 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.586310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.586311 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.586546 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.586914 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.586915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.586916 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.586984 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.587304 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.587305 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.587353 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.587439 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.587537 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326}
I20260812 16:46:37.587661 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.579600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55094 (local address 127.21.114.125:45633)
0812 16:46:37.579643 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.579645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.579937 (+ 292us) server_negotiation.cc:407] Connection header received
0812 16:46:37.580001 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.580003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.580016 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.580070 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.580543 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.581189 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.582156 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.582470 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.582530 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.584541 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.584542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.584542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.584550 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.586204 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.586636 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.586637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.586638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.586706 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.587072 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.587074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.587074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.587220 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.587297 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.587487 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.587572 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:37.588148 31855 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:37.588229 31541 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.588631 31541 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:37.588827 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.580092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56554 (local address 127.21.114.126:45783)
0812 16:46:37.580126 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.580128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.580161 (+ 33us) server_negotiation.cc:407] Connection header received
0812 16:46:37.580234 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.580235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.580242 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.580308 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.580972 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.581653 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.582509 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.582827 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.582911 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.585451 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.585453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.585453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.585461 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.587511 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.587890 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.587891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.587891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.587944 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.588175 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.588176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.588177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.588334 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.588465 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.588658 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.588735 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 16:46:37.590157 31873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.590412 31873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: This master's current role is: FOLLOWER
W20260812 16:46:37.590600 31898 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:37.590663 31898 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:46:37.591854 31414 master_runner.cc:186] Error getting master registration for 127.21.114.125:45633: OK, instance_id { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" instance_seqno: 1786553197400915 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 16:46:37.593693 31414 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 16:46:37.596109 31867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.588403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51224)
0812 16:46:37.588475 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.588484 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.588519 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.588919 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.588921 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.589074 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.589109 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.589111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.590013 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.590014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.590755 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.590757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.591267 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.591267 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.591311 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.591701 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.591706 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.593222 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.595103 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.595104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.595104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.595296 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.595480 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.595481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.595481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.595530 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.595819 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.595820 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.595853 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.595924 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.596016 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 16:46:37.596396 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.588484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51224 (local address 127.21.114.124:40807)
0812 16:46:37.588522 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.588523 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.588557 (+ 34us) server_negotiation.cc:407] Connection header received
0812 16:46:37.588576 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.588577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.588587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.588636 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.589193 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.589927 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.590840 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.591155 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.591225 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.593311 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.593312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.593312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.593318 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.595014 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.595368 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.595369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.595369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.595420 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.595587 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.595588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.595588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.595740 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.595798 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.596218 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.596283 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:46:37.598345 31855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: Bootstrap starting.
I20260812 16:46:37.599133 31855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:37.599427 31855 log.cc:824] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:37.600260 31855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: No bootstrap required, opened a new log
I20260812 16:46:37.600435 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.589478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55098 (local address 127.21.114.125:45633)
0812 16:46:37.589520 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.589522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.589608 (+ 86us) server_negotiation.cc:407] Connection header received
0812 16:46:37.589652 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.589653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.589664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.589737 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.591130 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.591804 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.594555 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.594766 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.594841 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.597251 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.597253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.597253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.597260 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.599075 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.599479 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.599480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.599481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.599542 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.599801 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.599802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.599803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.599949 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.600113 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.600191 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.600267 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:46:37.602128 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:37.602659 31855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.602825 31855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e68f1b414c444aa95d57cdc216c6db8, State: Initialized, Role: FOLLOWER
I20260812 16:46:37.602960 31855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.603178 31497 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "20affd942d7c4a04916e4d1aa20a02cd"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56554
I20260812 16:46:37.603374 31497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 16:46:37.603430 31497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:37.604146 31497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.604425 31497 leader_election.cc:288] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [CANDIDATE]: Term 1 election: Requested vote from peers 3d9a1776b3ef4866b447ca89e682b579 (127.21.114.125:45633), 4e68f1b414c444aa95d57cdc216c6db8 (127.21.114.124:40807)
I20260812 16:46:37.604748 31855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:37.604781 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20affd942d7c4a04916e4d1aa20a02cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4e68f1b414c444aa95d57cdc216c6db8"
I20260812 16:46:37.604882 31803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:37.605849 31803 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20affd942d7c4a04916e4d1aa20a02cd in term 1.
I20260812 16:46:37.606072 31445 leader_election.cc:302] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20affd942d7c4a04916e4d1aa20a02cd, 4e68f1b414c444aa95d57cdc216c6db8; no voters:
I20260812 16:46:37.606191 31873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:37.606349 31873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [term 1 LEADER]: Becoming Leader. State: Replica: 20affd942d7c4a04916e4d1aa20a02cd, State: Running, Role: LEADER
I20260812 16:46:37.606442 31873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.606901 31873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20affd942d7c4a04916e4d1aa20a02cd. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.606992 31873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:37.608145 31905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.608243 31905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 16:46:37.608956 31928 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:37.609061 31928 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:37.609589 31705 master_runner.cc:186] Error getting master registration for 127.21.114.125:45633: OK, instance_id { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" instance_seqno: 1786553197400915 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 16:46:37.611778 31705 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 16:46:37.613476 31936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:37.613698 31936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:37.618319 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.607002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.21.114.125:45633)
0812 16:46:37.607070 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.607072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.607262 (+ 190us) server_negotiation.cc:407] Connection header received
0812 16:46:37.607361 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.607362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.607372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.607401 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.608240 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.609017 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.612876 (+ 3859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.613252 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.613302 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.614964 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.614965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.614965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.614972 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.616678 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.617120 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.617121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.617122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.617202 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.617542 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.617543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.617544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.617680 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.617763 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.618152 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.618232 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:46:37.622370 31803 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [term 1 FOLLOWER]: Refusing update from remote peer 20affd942d7c4a04916e4d1aa20a02cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:37.622800 31873 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:37.623410 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.607333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56562 (local address 127.21.114.126:45783)
0812 16:46:37.608489 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.608491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.612455 (+ 3964us) server_negotiation.cc:407] Connection header received
0812 16:46:37.612506 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.612507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.612520 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.612592 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.613898 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.614615 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.616122 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.616480 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.616525 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.618723 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.618724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.618725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.618732 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.621579 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.622233 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.622234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.622235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.622299 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.622637 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.622638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.622639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.622779 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.622869 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.623249 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.623331 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1131}
I20260812 16:46:37.624862 31905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20affd942d7c4a04916e4d1aa20a02cd. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.624958 31905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:37.627730 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.607513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51230 (local address 127.21.114.124:40807)
0812 16:46:37.607549 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.607551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.612575 (+ 5024us) server_negotiation.cc:407] Connection header received
0812 16:46:37.612655 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.612656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.612665 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.612694 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.614557 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.615242 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.616296 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.616652 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.616698 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.620665 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.620666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.620667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.620674 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.622922 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.625642 (+ 2720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.625643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.625644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.626223 (+ 579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.626556 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.626557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.626558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.627211 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.627321 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.627561 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.627646 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 16:46:37.634690 31690 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } attempt: 3
I20260812 16:46:37.637398 31873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.637490 31873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:37.637557 31943 mvcc.cc:205] Tried to move back new op lower bound from 7317721897457905664 to 7317721897396768768. Current Snapshot: MvccSnapshot[applied={T|T < 7317721897457905664}]
I20260812 16:46:37.638067 31905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.638150 31905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:37.639340 31936 catalog_manager.cc:1347] Generated new cluster ID: 3b01a10bd17647eba2d7469353dd9eb5
I20260812 16:46:37.639400 31936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 16:46:37 dist-test-slave-45dx krb5kdc[31391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553197, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:46:37.645048 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.634947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:40807 (local address 127.0.0.1:51236)
0812 16:46:37.634997 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:37.635007 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:37.635043 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:37.635182 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:37.635183 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:37.635355 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:37.635412 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.635414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.636337 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.636337 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.637161 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:37.637164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.637631 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.637632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:37.637700 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.638332 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:37.638338 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:37.640668 (+ 2330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:37.642623 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.642623 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.642624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.642842 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.644345 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:37.644346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:37.644346 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:37.644426 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:37.644738 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:37.644739 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:37.644785 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 16:46:37.644845 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 16:46:37.644947 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 16:46:37.645087 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.634997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51236 (local address 127.21.114.124:40807)
0812 16:46:37.635048 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.635049 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.635092 (+ 43us) server_negotiation.cc:407] Connection header received
0812 16:46:37.635112 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.635113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.635123 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.635166 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.635489 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.636242 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.637271 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.637547 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.637627 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.640772 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:37.640773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:37.640773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:37.640781 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:37.642461 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.642921 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.642922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.642922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.642997 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:37.644510 (+ 1513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:37.644511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:37.644511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:37.644644 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:37.644703 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.644918 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.644999 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 16:46:37.646657 31690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: Bootstrap starting.
I20260812 16:46:37.647410 31690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:37.647727 31690 log.cc:824] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:37.648761 31690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: No bootstrap required, opened a new log
I20260812 16:46:37.650893 31690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.651032 31690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d9a1776b3ef4866b447ca89e682b579, State: Initialized, Role: FOLLOWER
I20260812 16:46:37.651117 31690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } }
I20260812 16:46:37.651432 31952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.651552 31649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20affd942d7c4a04916e4d1aa20a02cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3d9a1776b3ef4866b447ca89e682b579"
I20260812 16:46:37.651697 31952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:37.651530 31648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:37.651470 31690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:37.652556 31648 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [term 1 FOLLOWER]: Refusing update from remote peer 20affd942d7c4a04916e4d1aa20a02cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:37.652942 31924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:37.654054 31649 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20affd942d7c4a04916e4d1aa20a02cd in term 1.
I20260812 16:46:37.656533 31974 mvcc.cc:205] Tried to move back new op lower bound from 7317721897457905664 to 7317721897396768768. Current Snapshot: MvccSnapshot[applied={T|T < 7317721897457905664}]
I20260812 16:46:37.657030 31936 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:37.657069 31977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20affd942d7c4a04916e4d1aa20a02cd. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.657167 31977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:37.657205 31977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.657251 31977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:37.657768 31936 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:37.660959 31873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "20affd942d7c4a04916e4d1aa20a02cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20affd942d7c4a04916e4d1aa20a02cd" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 45783 } } peers { permanent_uuid: "3d9a1776b3ef4866b447ca89e682b579" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 45633 } } peers { permanent_uuid: "4e68f1b414c444aa95d57cdc216c6db8" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 40807 } } }
I20260812 16:46:37.661052 31873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:37.663115 31979 catalog_manager.cc:1259] Loaded cluster ID: 3b01a10bd17647eba2d7469353dd9eb5
I20260812 16:46:37.663168 31979 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: loading cluster ID for follower catalog manager: success
I20260812 16:46:37.664176 31936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20affd942d7c4a04916e4d1aa20a02cd: Generated new TSK 0
I20260812 16:46:37.664382 31936 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 16:46:37.664485 31979 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: acquiring CA information for follower catalog manager: success
I20260812 16:46:37.664845 31979 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d9a1776b3ef4866b447ca89e682b579: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 16:46:37.695354 31701 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.693862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55116 (local address 127.21.114.125:45633)
0812 16:46:37.693903 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.693905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.694654 (+ 749us) server_negotiation.cc:407] Connection header received
0812 16:46:37.694765 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.694766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.694777 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.694809 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.695279 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55116: BlockingRecv error: recv got EOF from 127.0.0.1:55116 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 16:46:37.696404 31551 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.693619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56578 (local address 127.21.114.126:45783)
0812 16:46:37.693669 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.693671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.695830 (+ 2159us) server_negotiation.cc:407] Connection header received
0812 16:46:37.695931 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.695932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.695943 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.695973 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.696278 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56578: BlockingRecv error: recv got EOF from 127.0.0.1:56578 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 16:46:37.697404 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.694351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51242 (local address 127.21.114.124:40807)
0812 16:46:37.694406 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.694408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.696824 (+ 2416us) server_negotiation.cc:407] Connection header received
0812 16:46:37.696963 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.696964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.696975 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.697006 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.697334 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51242: BlockingRecv error: recv got EOF from 127.0.0.1:51242 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:46:37.702549 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.699091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55126 (local address 127.21.114.125:45633)
0812 16:46:37.699139 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.699141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.699347 (+ 206us) server_negotiation.cc:407] Connection header received
0812 16:46:37.699466 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.699467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.699510 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.699553 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.699750 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.700528 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.701595 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.701896 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.701941 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.702163 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.702286 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.702332 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.702462 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.702481 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 16:46:37.706049 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.705206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51246 (local address 127.21.114.124:40807)
0812 16:46:37.705243 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.705245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.705484 (+ 239us) server_negotiation.cc:407] Connection header received
0812 16:46:37.705594 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.705595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.705613 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.705643 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.706001 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51246: BlockingRecv error: recv got EOF from 127.0.0.1:51246 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 16:46:37.712277 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.709117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.21.114.125:45633)
0812 16:46:37.709154 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.709156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.709369 (+ 213us) server_negotiation.cc:407] Connection header received
0812 16:46:37.709483 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.709484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.709493 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.709524 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.709716 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.710411 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.711471 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.711747 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.711792 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.712007 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.712042 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.712073 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.712187 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.712206 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 16:46:37.715618 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.714836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51254 (local address 127.21.114.124:40807)
0812 16:46:37.714874 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.714876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.715103 (+ 227us) server_negotiation.cc:407] Connection header received
0812 16:46:37.715199 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.715200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.715211 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.715241 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.715569 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51254: BlockingRecv error: recv got EOF from 127.0.0.1:51254 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:37.722174 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.718903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55152 (local address 127.21.114.125:45633)
0812 16:46:37.718940 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.718942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.719212 (+ 270us) server_negotiation.cc:407] Connection header received
0812 16:46:37.719311 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.719312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.719321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.719350 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.719539 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.720232 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.721340 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.721627 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.721675 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.721911 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.721946 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.721975 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.722084 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.722103 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 16:46:37.725585 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.724746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51262 (local address 127.21.114.124:40807)
0812 16:46:37.724787 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.724789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.725016 (+ 227us) server_negotiation.cc:407] Connection header received
0812 16:46:37.725118 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.725119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.725131 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.725162 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.725519 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51262: BlockingRecv error: recv got EOF from 127.0.0.1:51262 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:37.734195 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.730872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55156 (local address 127.21.114.125:45633)
0812 16:46:37.730913 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.730928 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.731213 (+ 285us) server_negotiation.cc:407] Connection header received
0812 16:46:37.731316 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.731317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.731328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.731356 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.731568 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.732264 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.733369 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.733662 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.733711 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.733930 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.733966 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.733996 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.734106 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.734126 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 16:46:37.738592 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.737386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51264 (local address 127.21.114.124:40807)
0812 16:46:37.737453 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.737455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.737750 (+ 295us) server_negotiation.cc:407] Connection header received
0812 16:46:37.737906 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.737908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.737921 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.737971 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.738523 (+ 552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51264: BlockingRecv error: recv got EOF from 127.0.0.1:51264 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 16:46:37.753363 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.748664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55164 (local address 127.21.114.125:45633)
0812 16:46:37.748739 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.748742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.749173 (+ 431us) server_negotiation.cc:407] Connection header received
0812 16:46:37.749345 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.749346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.749366 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.749420 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.749710 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.750621 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.752097 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.752518 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.752599 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.752931 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.752982 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.753028 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.753215 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.753245 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 16:46:37.758550 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.757201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.21.114.124:40807)
0812 16:46:37.757270 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.757272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.757680 (+ 408us) server_negotiation.cc:407] Connection header received
0812 16:46:37.757846 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.757847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.757868 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.757935 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.758485 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51270: BlockingRecv error: recv got EOF from 127.0.0.1:51270 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 16:46:37.779908 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.776333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55176 (local address 127.21.114.125:45633)
0812 16:46:37.776381 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.776383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.776746 (+ 363us) server_negotiation.cc:407] Connection header received
0812 16:46:37.776860 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.776861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.776874 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.776906 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.777110 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.777872 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.779041 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.779334 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.779382 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.779620 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.779657 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.779687 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.779801 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.779823 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 16:46:37.783483 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.782636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.21.114.124:40807)
0812 16:46:37.782677 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.782679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.782887 (+ 208us) server_negotiation.cc:407] Connection header received
0812 16:46:37.782990 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.782992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.783004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.783036 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.783426 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51286: BlockingRecv error: recv got EOF from 127.0.0.1:51286 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:46:37.819932 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.817092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55184 (local address 127.21.114.125:45633)
0812 16:46:37.817173 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.817176 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.817297 (+ 121us) server_negotiation.cc:407] Connection header received
0812 16:46:37.817376 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.817377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.817388 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.817476 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.817619 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.818322 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.819192 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.819410 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.819501 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.819658 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.819695 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.819758 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.819819 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.819840 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 16:46:37.822449 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.821736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51298 (local address 127.21.114.124:40807)
0812 16:46:37.821831 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.821833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.821882 (+ 49us) server_negotiation.cc:407] Connection header received
0812 16:46:37.821919 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.821920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.821931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.821986 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.822391 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51298: BlockingRecv error: recv got EOF from 127.0.0.1:51298 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 16:46:37.890666 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:37.887552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55192 (local address 127.21.114.125:45633)
0812 16:46:37.887675 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.887678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.887837 (+ 159us) server_negotiation.cc:407] Connection header received
0812 16:46:37.887939 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.887940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.887959 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.888030 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:37.888191 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.888882 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.889840 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:37.890086 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:37.890169 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:37.890335 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:37.890382 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:37.890451 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:37.890541 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 16:46:37.890562 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 16:46:37.893285 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:37.892510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51314 (local address 127.21.114.124:40807)
0812 16:46:37.892583 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:37.892586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:37.892663 (+ 77us) server_negotiation.cc:407] Connection header received
0812 16:46:37.892759 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:37.892760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:37.892774 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:37.892825 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:37.893199 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51314: BlockingRecv error: recv got EOF from 127.0.0.1:51314 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 16:46:38.025180 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.022534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.21.114.125:45633)
0812 16:46:38.022722 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.022753 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.022834 (+ 81us) server_negotiation.cc:407] Connection header received
0812 16:46:38.022933 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.022939 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.022949 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.023015 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.023156 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.023644 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.024463 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.024654 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.024753 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.024916 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.024951 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.025009 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.025064 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.025085 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
W20260812 16:46:38.027554 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:38.026897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51330 (local address 127.21.114.124:40807)
0812 16:46:38.026965 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.026967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.027006 (+ 39us) server_negotiation.cc:407] Connection header received
0812 16:46:38.027076 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.027077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.027088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.027144 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:38.027491 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51330: BlockingRecv error: recv got EOF from 127.0.0.1:51330 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:46:38.287010 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.284806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55206 (local address 127.21.114.125:45633)
0812 16:46:38.284899 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.284900 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.284932 (+ 32us) server_negotiation.cc:407] Connection header received
0812 16:46:38.284959 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.284960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.284969 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.285011 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.285139 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.285624 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.286454 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.286638 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.286692 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.286809 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.286840 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.286880 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.286934 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.286951 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 16:46:38.289443 31868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:38.288762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51346 (local address 127.21.114.124:40807)
0812 16:46:38.288827 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.288828 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.288837 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:38.288971 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.288972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.288984 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.289047 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:38.289390 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51346: BlockingRecv error: recv got EOF from 127.0.0.1:51346 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 16:46:38.609620 31928 catalog_manager.cc:1259] Loaded cluster ID: 3b01a10bd17647eba2d7469353dd9eb5
I20260812 16:46:38.609700 31928 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: loading cluster ID for follower catalog manager: success
I20260812 16:46:38.610633 31928 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: acquiring CA information for follower catalog manager: success
I20260812 16:46:38.610965 31928 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4e68f1b414c444aa95d57cdc216c6db8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:46:38.805307 32202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.802641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55210 (local address 127.21.114.125:45633)
0812 16:46:38.802771 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.802773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.802842 (+ 69us) server_negotiation.cc:407] Connection header received
0812 16:46:38.802934 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.802935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.802953 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.803029 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.803174 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.803674 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.804527 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.804745 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.804808 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.805042 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.805072 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.805113 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.805167 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.805188 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260812 16:46:38.809827 32210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.807337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51352 (local address 127.21.114.124:40807)
0812 16:46:38.807449 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.807451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.807460 (+ 9us) server_negotiation.cc:407] Connection header received
0812 16:46:38.807489 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.807490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.807537 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.807606 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.807824 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.808287 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.809097 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.809283 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.809332 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.809474 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.809579 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.809634 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.809750 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.809766 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
I20260812 16:46:38.814416 32202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.811475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55226 (local address 127.21.114.125:45633)
0812 16:46:38.811568 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.811570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.811726 (+ 156us) server_negotiation.cc:407] Connection header received
0812 16:46:38.811791 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.811792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.811802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.811850 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.812015 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.812768 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.813724 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.813964 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.814026 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.814160 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.814190 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.814241 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.814310 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.814335 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 16:46:38.814772 32210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.811675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51368 (local address 127.21.114.124:40807)
0812 16:46:38.811716 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.811718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.811822 (+ 104us) server_negotiation.cc:407] Connection header received
0812 16:46:38.811882 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.811891 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.811901 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.811947 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.812086 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.812801 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.813932 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.814228 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.814292 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.814463 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.814498 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.814530 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.814634 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.814664 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:46:38.815376 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:38.811467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56584 (local address 127.21.114.126:45783)
0812 16:46:38.811619 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:38.811622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:38.811671 (+ 49us) server_negotiation.cc:407] Connection header received
0812 16:46:38.811865 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:38.811866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:38.811916 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:38.811974 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:38.812170 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.812752 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.814332 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:38.814628 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:38.814691 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:38.814986 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:38.815098 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:38.815140 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:38.815265 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 16:46:38.815293 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":58,"threads_started":1}
I20260812 16:46:38.817037 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31414
I20260812 16:46:38.838188 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31557
I20260812 16:46:38.849741 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 31705
2026-08-12T16:46:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3182 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 16:46:38 dist-test-slave-45dx krb5kdc[32227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 16:46:38 dist-test-slave-45dx krb5kdc[32227](info): set up 2 sockets
Aug 12 16:46:38 dist-test-slave-45dx krb5kdc[32227](info): commencing operation
krb5kdc: starting...
W20260812 16:46:40.198760 21961 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/test-user.keytab.
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T16:46:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T16:46:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.114.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
Entry for principal kudu/127.21.114.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab.
I20260812 16:46:40.325562 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:32979
--webserver_interface=127.21.114.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:32979,127.21.114.125:39247,127.21.114.124:42109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 16:46:40.409485 32249 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 16:46:40.409688 32249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:40.409705 32249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:40.409724 32249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:40.410964 32249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:40.411006 32249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:40.411020 32249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:40.411033 32249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:40.411046 32249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:40.412588 32249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:32979,127.21.114.125:39247,127.21.114.124:42109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.126.keytab
--principal=kudu/127.21.114.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.126:32979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.114.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:40.412846 32249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:40.413084 32249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:40.417876 32267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:40.417968 32269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:40.417886 32266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:40.418148 32249 server_base.cc:1034] running on GCE node
I20260812 16:46:40.418561 32249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:40.418880 32249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:40.420056 32249 hybrid_clock.cc:648] HybridClock initialized: now 1786553200420040 us; error 44 us; skew 500 ppm
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:40.429452 32249 init.cc:377] Logged in from keytab as kudu/127.21.114.126@KRBTEST.COM (short username kudu)
I20260812 16:46:40.429998 32249 webserver.cc:460] Webserver started at http://127.21.114.126:39619/ using document root <none> and password file <none>
I20260812 16:46:40.430239 32249 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:40.430310 32249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:40.430476 32249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:40.431603 32249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data/instance:
uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "bdfd5c42469e22edbfd46dffbe79cd54"
server_key_iv: "c6abceb950ebdd5e1aacbf856bdadb26"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.431996 32249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal/instance:
uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "bdfd5c42469e22edbfd46dffbe79cd54"
server_key_iv: "c6abceb950ebdd5e1aacbf856bdadb26"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.433523 32249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:40.434275 32284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:40.434450 32249 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:40.434561 32249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal
uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "bdfd5c42469e22edbfd46dffbe79cd54"
server_key_iv: "c6abceb950ebdd5e1aacbf856bdadb26"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.434638 32249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:40.453496 32249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:40.455523 32249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:40.455704 32249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:40.460093 32249 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.126:32979
I20260812 16:46:40.460129 32390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.126:32979 every 8 connection(s)
I20260812 16:46:40.460554 32249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/data/info.pb
I20260812 16:46:40.460971 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32249
I20260812 16:46:40.461091 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-0/wal/instance
I20260812 16:46:40.461293 21961 external_mini_cluster.cc:1428] Setting key 97d776686cb408c795fe47d59453e77e
I20260812 16:46:40.461625 32397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:40.463191 32397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.114.125@KRBTEST.COM; defaulting to no policy
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.125@KRBTEST.COM" created.
I20260812 16:46:40.473949 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.463859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32979 (local address 127.0.0.1:41468)
0812 16:46:40.464086 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.464129 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.464644 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.464996 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.464999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.465280 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.465461 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.465466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.467103 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.467104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.467782 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.467784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.468559 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.468560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.468622 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.469169 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.469178 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.470533 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.472285 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.472293 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.472295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.472550 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.472845 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.472845 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.472846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.472996 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.473501 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.473508 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.473570 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.473643 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.473774 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
I20260812 16:46:40.474061 32403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.463929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41468 (local address 127.21.114.126:32979)
0812 16:46:40.464089 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.464100 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.464222 (+ 122us) server_negotiation.cc:407] Connection header received
0812 16:46:40.464809 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.464812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.464836 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.464946 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.465585 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.466980 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.467899 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.468470 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.468591 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.470619 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.470626 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.470627 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.470633 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.472183 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.472653 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.472656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.472656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.472770 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.473116 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.473118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.473118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.473399 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.473502 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.473711 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.473874 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260812 16:46:40.474761 32397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:40.475253 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.475106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35640)
0812 16:46:40.475167 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.475223 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 16:46:40.475430 32286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
I20260812 16:46:40.475879 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.475769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35648)
0812 16:46:40.475818 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.475851 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 16:46:40.476040 32397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:39247: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab.
Entry for principal kudu/127.21.114.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab.
I20260812 16:46:40.489241 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:39247
--webserver_interface=127.21.114.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab
--principal=kudu/127.21.114.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:32979,127.21.114.125:39247,127.21.114.124:42109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:46:40.525300 32397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } attempt: 1
I20260812 16:46:40.525876 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.525715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35664)
0812 16:46:40.525788 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.525838 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 16:46:40.526292 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.526159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35680)
0812 16:46:40.526212 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.526250 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 16:46:40.526449 32397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:39247: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
W20260812 16:46:40.573153 32407 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 16:46:40.573374 32407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:40.573392 32407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:40.573412 32407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:40.574570 32407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:40.574615 32407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:40.574628 32407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:40.574666 32407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:40.574692 32407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:40.576149 32407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:32979,127.21.114.125:39247,127.21.114.124:42109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.125.keytab
--principal=kudu/127.21.114.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.125:39247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.114.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:40.576436 32407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:40.576682 32407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:40.581570 32419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:40.581624 32422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:40.581570 32428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:40.581885 32407 server_base.cc:1034] running on GCE node
I20260812 16:46:40.582190 32407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:40.582541 32407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:40.583726 32407 hybrid_clock.cc:648] HybridClock initialized: now 1786553200583706 us; error 47 us; skew 500 ppm
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:40.586382 32407 init.cc:377] Logged in from keytab as kudu/127.21.114.125@KRBTEST.COM (short username kudu)
I20260812 16:46:40.586822 32407 webserver.cc:460] Webserver started at http://127.21.114.125:42343/ using document root <none> and password file <none>
I20260812 16:46:40.587049 32407 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:40.587119 32407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:40.587272 32407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:40.588406 32407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data/instance:
uuid: "74d0898ad0454b4491203766d12ff1d4"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "c69ef7ce530d92921425bd424d6ca0d1"
server_key_iv: "516552c51c1161c8935ed45ccd3a868c"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.588778 32407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal/instance:
uuid: "74d0898ad0454b4491203766d12ff1d4"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "c69ef7ce530d92921425bd424d6ca0d1"
server_key_iv: "516552c51c1161c8935ed45ccd3a868c"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.590150 32407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 16:46:40.590909 32445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:40.591105 32407 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 16:46:40.591212 32407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal
uuid: "74d0898ad0454b4491203766d12ff1d4"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "c69ef7ce530d92921425bd424d6ca0d1"
server_key_iv: "516552c51c1161c8935ed45ccd3a868c"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.591286 32407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:40.594619 32397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } attempt: 2
I20260812 16:46:40.595106 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.594959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35686)
0812 16:46:40.595030 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.595071 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 16:46:40.595468 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.595382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35700)
0812 16:46:40.595423 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.595449 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 16:46:40.595564 32397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.125:39247: Network error: Client connection negotiation failed: client connection to 127.21.114.125:39247: connect: Connection refused (error 111)
I20260812 16:46:40.619974 32407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:40.622231 32407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:40.622350 32407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:40.626610 32407 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.125:39247
I20260812 16:46:40.626649 32544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.125:39247 every 8 connection(s)
I20260812 16:46:40.627014 32407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/data/info.pb
I20260812 16:46:40.627926 32547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:40.629562 32547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:40.634984 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32407
I20260812 16:46:40.635102 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-1/wal/instance
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:40.636047 21961 external_mini_cluster.cc:1428] Setting key ecb4dde47927b8b83e0f976867468afb
I20260812 16:46:40.639353 32403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.630282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41470 (local address 127.21.114.126:32979)
0812 16:46:40.630348 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.630351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.630618 (+ 267us) server_negotiation.cc:407] Connection header received
0812 16:46:40.631080 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.631081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.631091 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.631147 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.631748 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.632232 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.633270 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.633469 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.633524 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.635872 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.635874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.635874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.635883 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.637730 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.638214 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.638215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.638216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.638295 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.638593 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.638594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.638595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.638756 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.638847 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.639176 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.639261 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 16:46:40.639568 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.630277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32979 (local address 127.0.0.1:41470)
0812 16:46:40.630477 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.630516 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.630994 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.631222 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.631225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.631473 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.631673 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.631677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.632358 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.632359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.633188 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.633190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.633544 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.633544 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.633645 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.634102 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.634110 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.635754 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.637825 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.637832 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.637834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.638098 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.638363 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.638364 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.638364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.638520 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.638852 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.638860 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.639036 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.639143 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.639302 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260812 16:46:40.640223 32547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.114.124@KRBTEST.COM; defaulting to no policy
I20260812 16:46:40.648012 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.640520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35704)
0812 16:46:40.640575 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.640587 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.640632 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.640873 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.640874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.641061 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.641128 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.641130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.642044 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.642045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.642930 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.642933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.643425 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.643426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.643509 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.643876 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.643882 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.645193 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.646965 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.646966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.646966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.647136 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.647353 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.647354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.647354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.647416 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.647692 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.647693 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.647731 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.647804 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.647903 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 16:46:40.648094 32556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.640558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35704 (local address 127.21.114.125:39247)
0812 16:46:40.640721 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.640725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.640743 (+ 18us) server_negotiation.cc:407] Connection header received
0812 16:46:40.640773 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.640774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.640785 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.640849 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.641205 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.641957 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.643022 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.643334 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.643392 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.645297 (+ 1905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.645305 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.645305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.645312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.646862 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.647225 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.647230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.647230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.647288 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.647480 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.647480 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.647481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.647620 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.647715 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.647835 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.647956 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.114.124@KRBTEST.COM" created.
I20260812 16:46:40.648789 32547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:40.649148 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.649032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52540)
0812 16:46:40.649081 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.649125 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 16:46:40.649322 32448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
I20260812 16:46:40.649763 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.649677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52556)
0812 16:46:40.649720 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.649745 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 16:46:40.649900 32547 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:42109: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.114.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab.
Entry for principal kudu/127.21.114.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab.
I20260812 16:46:40.663695 21961 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskP_fNe3/build/release/bin/kudu
/tmp/dist-test-taskP_fNe3/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:42109
--webserver_interface=127.21.114.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab
--principal=kudu/127.21.114.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.114.84:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.114.126:32979,127.21.114.125:39247,127.21.114.124:42109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 16:46:40.686715 32397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } attempt: 3
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:46:40.694609 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.687153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35714)
0812 16:46:40.687221 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.687244 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.687328 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.687517 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.687518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.687691 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.687790 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.687793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.688576 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.688577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.689129 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.689131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.689535 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.689536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.689619 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.690173 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.690179 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.691642 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.693467 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.693468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.693469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.693655 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.693873 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.693874 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.693875 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.693942 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.694314 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.694316 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.694364 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.694435 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.694520 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 16:46:40.694662 32556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.687231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35714 (local address 127.21.114.125:39247)
0812 16:46:40.687298 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.687301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.687312 (+ 11us) server_negotiation.cc:407] Connection header received
0812 16:46:40.687424 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.687425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.687437 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.687509 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.687885 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.688475 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.689218 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.689456 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.689537 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.691766 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.691768 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.691768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.691775 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.693360 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.693739 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.693740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.693741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.693802 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.694051 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.694053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.694053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.694208 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.694294 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.694483 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.694573 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 16:46:40.695140 32397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:40.695493 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.695381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52560)
0812 16:46:40.695433 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.695464 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 16:46:40.695813 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.695710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52570)
0812 16:46:40.695765 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.695789 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 16:46:40.695904 32397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:42109: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
I20260812 16:46:40.699120 32547 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } attempt: 1
I20260812 16:46:40.699517 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.699393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52584)
0812 16:46:40.699450 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.699486 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 16:46:40.699924 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.699813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52594)
0812 16:46:40.699872 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.699902 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 16:46:40.700043 32547 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:42109: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
I20260812 16:46:40.727058 32397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } attempt: 1
I20260812 16:46:40.727587 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.727444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52596)
0812 16:46:40.727515 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.727554 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 16:46:40.727953 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.727846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52606)
0812 16:46:40.727896 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.727923 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 16:46:40.728101 32397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:42109: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
W20260812 16:46:40.748637 32562 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 16:46:40.748844 32562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 16:46:40.748862 32562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 16:46:40.748881 32562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 16:46:40.749969 32562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 16:46:40.750001 32562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 16:46:40.750015 32562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 16:46:40.750028 32562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 16:46:40.750039 32562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 16:46:40.751457 32562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.114.84:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.114.126:32979,127.21.114.125:39247,127.21.114.124:42109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/krb5kdc/kudu_127.21.114.124.keytab
--principal=kudu/127.21.114.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.114.124:42109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.114.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 15:46:00 UTC on ccycloud.quasar-illntx.root.comops.site
build id 4583010
I20260812 16:46:40.751646 32562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 16:46:40.751822 32562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 16:46:40.756734 32573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 16:46:40.756734 32578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:40.756834 32562 server_base.cc:1034] running on GCE node
W20260812 16:46:40.756772 32576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 16:46:40.757282 32562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 16:46:40.757565 32562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 16:46:40.758697 32562 hybrid_clock.cc:648] HybridClock initialized: now 1786553200758673 us; error 34 us; skew 500 ppm
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 16:46:40.761310 32562 init.cc:377] Logged in from keytab as kudu/127.21.114.124@KRBTEST.COM (short username kudu)
I20260812 16:46:40.761754 32562 webserver.cc:460] Webserver started at http://127.21.114.124:38053/ using document root <none> and password file <none>
I20260812 16:46:40.762007 32562 fs_manager.cc:359] Metadata directory not provided
I20260812 16:46:40.762079 32562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 16:46:40.762235 32562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 16:46:40.763295 32562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data/instance:
uuid: "2361920df1d24b53b8730b20f910e095"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "766503fdb4cc4e55d4162195c1dbbb15"
server_key_iv: "44055c679e34a4a8f01362d4d7709081"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.763656 32562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal/instance:
uuid: "2361920df1d24b53b8730b20f910e095"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "766503fdb4cc4e55d4162195c1dbbb15"
server_key_iv: "44055c679e34a4a8f01362d4d7709081"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.765112 32562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 16:46:40.765832 32588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 16:46:40.766005 32562 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 16:46:40.766108 32562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data,/tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal
uuid: "2361920df1d24b53b8730b20f910e095"
format_stamp: "Formatted at 2026-08-12 16:46:40 on dist-test-slave-45dx"
server_key: "766503fdb4cc4e55d4162195c1dbbb15"
server_key_iv: "44055c679e34a4a8f01362d4d7709081"
server_key_version: "encryptionkey@0"
I20260812 16:46:40.766191 32562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 16:46:40.768198 32547 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } attempt: 2
I20260812 16:46:40.768643 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.768497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52608)
0812 16:46:40.768570 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.768614 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 16:46:40.768961 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.768905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52624)
0812 16:46:40.768927 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.768948 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260812 16:46:40.769064 32547 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.114.124:42109: Network error: Client connection negotiation failed: client connection to 127.21.114.124:42109: connect: Connection refused (error 111)
I20260812 16:46:40.785849 32562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 16:46:40.788275 32562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 16:46:40.788509 32562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 16:46:40.792441 32562 rpc_server.cc:307] RPC server started. Bound to: 127.21.114.124:42109
I20260812 16:46:40.792527 32682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.114.124:42109 every 8 connection(s)
I20260812 16:46:40.792917 32562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/data/info.pb
I20260812 16:46:40.793772 32684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 16:46:40.795475 32684 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:40.799036 21961 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskP_fNe3/build/release/bin/kudu as pid 32562
I20260812 16:46:40.799180 21961 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskP_fNe3/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786552916613187-21961-0/minicluster-data/master-2/wal/instance
I20260812 16:46:40.799445 21961 external_mini_cluster.cc:1428] Setting key 5c4f29d79ee6647ffe3c0bbfebf1913f
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:40.803252 32397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } attempt: 2
I20260812 16:46:40.805042 32403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.796199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41474 (local address 127.21.114.126:32979)
0812 16:46:40.796295 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.796322 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.796448 (+ 126us) server_negotiation.cc:407] Connection header received
0812 16:46:40.796891 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.796892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.796902 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.796953 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.797501 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.797969 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.798932 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.799164 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.799234 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.801916 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.801918 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.801918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.801925 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.803478 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.803977 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.803978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.803978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.804039 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.804325 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.804326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.804326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.804485 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.804552 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.804871 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.804953 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 16:46:40.805231 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.796127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.126:32979 (local address 127.0.0.1:41474)
0812 16:46:40.796278 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.796358 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.796802 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.797007 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.797010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.797238 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.797428 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.797432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.798049 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.798050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.798811 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.798812 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.799261 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.799262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.799444 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.800041 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.800051 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.801829 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.803569 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.803575 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.803576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.803894 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.804107 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.804108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.804108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.804219 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.804559 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.804566 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.804720 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.804847 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.804996 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260812 16:46:40.805773 32684 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.126@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:46:40.810614 32696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.799856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52638 (local address 127.21.114.124:42109)
0812 16:46:40.800024 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.800029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.800809 (+ 780us) server_negotiation.cc:407] Connection header received
0812 16:46:40.800859 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.800861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.800882 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.800959 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.801692 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.802649 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.803792 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.804279 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.804382 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.807322 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.807329 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.807330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.807337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.809368 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.809716 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.809719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.809719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.809804 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.810007 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.810008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.810008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.810153 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.810298 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.810386 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.810501 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:46:40.813716 32401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.803661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52644)
0812 16:46:40.803708 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.803718 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.803751 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.804106 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.804107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.804279 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.804341 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.804342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.805230 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.805231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.805969 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.805972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.806425 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.806426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.806489 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.807493 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.807499 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.808991 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.811937 (+ 2946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.811938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.811938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.812185 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.812425 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.812426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.812426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.812498 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.813400 (+ 902us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.813401 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.813445 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.813521 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.813607 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 16:46:40.813766 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.803842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52644 (local address 127.21.114.124:42109)
0812 16:46:40.803988 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.803989 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.803995 (+ 6us) server_negotiation.cc:407] Connection header received
0812 16:46:40.804012 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.804013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.804020 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.804117 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.804426 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.805121 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.806064 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.806348 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.806410 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.809081 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.809083 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.809103 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.809110 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.811850 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.812252 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.812253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.812253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.812344 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.812555 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.812556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.812557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.813323 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.813405 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.813543 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.813625 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":94,"threads_started":1}
I20260812 16:46:40.814292 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.805997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.125:39247 (local address 127.0.0.1:35720)
0812 16:46:40.806035 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.806044 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.806075 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.806520 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.806521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.806671 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.806723 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.806724 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.807446 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.807447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.808068 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.808070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.808783 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.808784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.808847 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.809207 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.809211 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.811410 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.813167 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.813168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.813168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.813425 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.813619 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.813620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.813620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.813674 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.813974 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.813975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.814021 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.814095 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.814183 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 16:46:40.814314 32556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.806304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35720 (local address 127.21.114.125:39247)
0812 16:46:40.806366 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.806368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.806376 (+ 8us) server_negotiation.cc:407] Connection header received
0812 16:46:40.806403 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.806404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.806415 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.806470 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.806812 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.807363 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.808445 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.808650 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.808734 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.811496 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.811498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.811511 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.811520 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.813063 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.813482 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.813484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.813484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.813544 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.813739 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.813739 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.813740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.813880 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.813942 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.814142 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.814225 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 16:46:40.814970 32684 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } has no permanent_uuid. Determining permanent_uuid...
I20260812 16:46:40.816229 32397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219: Bootstrap starting.
I20260812 16:46:40.817087 32397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219: Neither blocks nor log segments found. Creating new log.
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.126@KRBTEST.COM
I20260812 16:46:40.817420 32397 log.cc:824] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:40.818595 32397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219: No bootstrap required, opened a new log
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.124@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:46:40.821075 32403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.812381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41484 (local address 127.21.114.126:32979)
0812 16:46:40.812423 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.812425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.812562 (+ 137us) server_negotiation.cc:407] Connection header received
0812 16:46:40.812580 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.812580 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.812589 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.812630 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.813104 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.813664 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.814677 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.814978 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.815061 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.817636 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.817637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.817637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.817644 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.819589 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.819973 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.819975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.819975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.820034 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.820229 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.820230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.820230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.820372 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.820517 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.820899 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.820980 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 16:46:40.820973 32397 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.821399 32397 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8daf9a3c1b04f13bc6b1a662d6f2219, State: Initialized, Role: FOLLOWER
I20260812 16:46:40.821565 32397 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.821972 32397 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:40.821954 32700 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.822131 32700 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.822693 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.815197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52648)
0812 16:46:40.815325 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.815335 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.815379 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.815512 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.815513 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.815678 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.815720 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.815722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.816649 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.816650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.817105 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.817107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.817483 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.817484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.817534 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.817903 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.817911 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.819211 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.820894 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.820895 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.820895 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.821054 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.821263 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.821264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.821264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.821316 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.822315 (+ 999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.822316 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.822363 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.822434 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.822519 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 16:46:40.822778 32696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.815267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52648 (local address 127.21.114.124:42109)
0812 16:46:40.815302 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.815304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.815372 (+ 68us) server_negotiation.cc:407] Connection header received
0812 16:46:40.815445 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.815445 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.815455 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.815509 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.815803 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.816570 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.817194 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.817401 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.817482 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.819302 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.819303 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.819303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.819311 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.820783 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.821135 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.821136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.821136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.821190 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.821402 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.821404 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.821404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.821637 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.821715 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.822502 (+ 787us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.822601 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 16:46:40.823865 32719 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:40.823968 32719 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:40.824769 32684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: Bootstrap starting.
I20260812 16:46:40.825510 32684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:40.825866 32684 log.cc:824] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: Log is configured to *not* fsync() on all Append() calls
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.114.125@KRBTEST.COM
I20260812 16:46:40.824704 32249 master_runner.cc:186] Error getting master registration for 127.21.114.125:39247: OK, instance_id { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" instance_seqno: 1786553200625345 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 16:46:40.827358 32249 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 16:46:40.828052 32684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: No bootstrap required, opened a new log
I20260812 16:46:40.829586 32684 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.829751 32684 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2361920df1d24b53b8730b20f910e095, State: Initialized, Role: FOLLOWER
I20260812 16:46:40.829880 32684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.830229 32684 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:40.830327 32722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.830525 32722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.831218 32556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.822103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35724 (local address 127.21.114.125:39247)
0812 16:46:40.822152 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.822154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.822225 (+ 71us) server_negotiation.cc:407] Connection header received
0812 16:46:40.822294 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.822295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.822307 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.822355 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.823005 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.823679 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.824610 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.824929 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.824991 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.827707 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.827709 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.827709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.827717 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.829513 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.829948 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.829950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.829950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.830018 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.830247 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.830249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.830249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.830393 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.830970 (+ 577us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.831020 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.831117 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 16:46:40.832562 21961 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 16:46:40.833464 32336 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41484
I20260812 16:46:40.833602 32336 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 16:46:40.833649 32336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 0 FOLLOWER]: Advancing to term 1
W20260812 16:46:40.833971 32743 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 16:46:40.834021 32743 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 16:46:40.834775 32336 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.835007 32336 leader_election.cc:288] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [CANDIDATE]: Term 1 election: Requested vote from peers 74d0898ad0454b4491203766d12ff1d4 (127.21.114.125:39247), 2361920df1d24b53b8730b20f910e095 (127.21.114.124:42109)
I20260812 16:46:40.835624 32638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2361920df1d24b53b8730b20f910e095"
I20260812 16:46:40.835718 32638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:40.833595 32562 master_runner.cc:186] Error getting master registration for 127.21.114.125:39247: OK, instance_id { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" instance_seqno: 1786553200625345 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 16:46:40.836051 32562 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 16:46:40.836622 32638 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8daf9a3c1b04f13bc6b1a662d6f2219 in term 1.
I20260812 16:46:40.836791 32286 leader_election.cc:302] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2361920df1d24b53b8730b20f910e095, f8daf9a3c1b04f13bc6b1a662d6f2219; no voters:
I20260812 16:46:40.836925 32700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 16:46:40.837122 32700 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [term 1 LEADER]: Becoming Leader. State: Replica: f8daf9a3c1b04f13bc6b1a662d6f2219, State: Running, Role: LEADER
I20260812 16:46:40.837234 32700 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.840575 32750 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8daf9a3c1b04f13bc6b1a662d6f2219. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.840684 32750 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:40.840975 32752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 16:46:40.841408 32752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 16:46:40.843173 32638 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [term 1 FOLLOWER]: Refusing update from remote peer f8daf9a3c1b04f13bc6b1a662d6f2219: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:40.843492 32750 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:40.844691 32722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8daf9a3c1b04f13bc6b1a662d6f2219. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.844805 32722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.860190 32547 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } attempt: 3
I20260812 16:46:40.861486 32403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.841122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41492 (local address 127.21.114.126:32979)
0812 16:46:40.841169 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.841171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.852497 (+ 11326us) server_negotiation.cc:407] Connection header received
0812 16:46:40.852588 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.852589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.852605 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.852673 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.853600 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.854355 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.855432 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.855723 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.855765 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.857649 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.857650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.857650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.857658 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.859410 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.860011 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.860012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.860013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.860089 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.860666 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.860667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.860668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.860835 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.860916 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.861281 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.861369 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 16:46:40.862237 32556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.841368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35740 (local address 127.21.114.125:39247)
0812 16:46:40.841411 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.841413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.852668 (+ 11255us) server_negotiation.cc:407] Connection header received
0812 16:46:40.852702 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.852703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.852716 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.852770 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.853677 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.854386 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.855919 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.856207 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.856242 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.858429 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.858431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.858431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.858440 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.860132 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.860821 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.860822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.860822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.860897 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.861199 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.861200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.861200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.861342 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.861422 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.862060 (+ 638us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.862143 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 16:46:40.864789 32700 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.864892 32700 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: This master's current role is: LEADER
Aug 12 16:46:40 dist-test-slave-45dx krb5kdc[32227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786553200, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.114.125@KRBTEST.COM for kudu/127.21.114.124@KRBTEST.COM
I20260812 16:46:40.865202 32756 mvcc.cc:205] Tried to move back new op lower bound from 7317721910651314176 to 7317721910629965824. Current Snapshot: MvccSnapshot[applied={T|T < 7317721910651314176}]
I20260812 16:46:40.865363 32722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.865455 32722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.865513 32752 catalog_manager.cc:1347] Generated new cluster ID: 6f6f58b82cb44da4b2154f1897cffc4f
I20260812 16:46:40.865557 32752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 16:46:40.865703 32758 mvcc.cc:205] Tried to move back new op lower bound from 7317721910651314176 to 7317721910629965824. Current Snapshot: MvccSnapshot[applied={T|T < 7317721910651314176}]
I20260812 16:46:40.868291 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.860516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.114.124:42109 (local address 127.0.0.1:52672)
0812 16:46:40.860612 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 16:46:40.860622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 16:46:40.860657 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 16:46:40.860921 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 16:46:40.860922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 16:46:40.861086 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 16:46:40.861126 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.861127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.862130 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.862132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.862921 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 16:46:40.862923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.863401 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.863402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 16:46:40.863484 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.863903 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 16:46:40.863908 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 16:46:40.865620 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 16:46:40.867374 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.867375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.867375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.867561 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.867738 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 16:46:40.867739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 16:46:40.867739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 16:46:40.867786 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 16:46:40.868026 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 16:46:40.868026 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 16:46:40.868065 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 16:46:40.868121 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 16:46:40.868203 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 16:46:40.868752 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.860726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52672 (local address 127.21.114.124:42109)
0812 16:46:40.860778 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.860780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.860787 (+ 7us) server_negotiation.cc:407] Connection header received
0812 16:46:40.860809 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.860809 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.860832 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.860879 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.861209 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.862033 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.863016 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.863341 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.863406 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.865718 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.865719 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.865719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.865726 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.867291 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.867628 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.867629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.867629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.867680 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.867837 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.867838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.867838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.867955 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.868003 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.868584 (+ 581us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.868664 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 16:46:40.870558 32547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: Bootstrap starting.
I20260812 16:46:40.871330 32547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: Neither blocks nor log segments found. Creating new log.
I20260812 16:46:40.871626 32547 log.cc:824] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: Log is configured to *not* fsync() on all Append() calls
I20260812 16:46:40.873217 32696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:40.841689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.21.114.124:42109)
0812 16:46:40.841741 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.841743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.852793 (+ 11050us) server_negotiation.cc:407] Connection header received
0812 16:46:40.853492 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.853493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.853505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.853535 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.854252 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.855001 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.863505 (+ 8504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:40.863793 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:40.863860 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:40.870069 (+ 6209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 16:46:40.870070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 16:46:40.870071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 16:46:40.870078 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 16:46:40.871563 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.872227 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.872228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.872228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.872279 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 16:46:40.872573 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 16:46:40.872573 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 16:46:40.872574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 16:46:40.872696 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 16:46:40.872765 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:40.873062 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 16:46:40.873135 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 16:46:40.879245 32752 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 16:46:40.879508 32547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: No bootstrap required, opened a new log
I20260812 16:46:40.879964 32752 catalog_manager.cc:1504] Loading token signing keys...
I20260812 16:46:40.881592 32547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.881767 32547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d0898ad0454b4491203766d12ff1d4, State: Initialized, Role: FOLLOWER
I20260812 16:46:40.881856 32547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } }
I20260812 16:46:40.882179 32547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 16:46:40.882577 32499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "74d0898ad0454b4491203766d12ff1d4"
I20260812 16:46:40.882812 32497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 16:46:40.883649 32497 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [term 1 FOLLOWER]: Refusing update from remote peer f8daf9a3c1b04f13bc6b1a662d6f2219: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 16:46:40.883996 32700 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 16:46:40.884742 32499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8daf9a3c1b04f13bc6b1a662d6f2219 in term 1.
I20260812 16:46:40.885391 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.885527 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.887153 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8daf9a3c1b04f13bc6b1a662d6f2219. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.887235 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.887269 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.887331 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 16:46:40.889488 319 catalog_manager.cc:1259] Loaded cluster ID: 6f6f58b82cb44da4b2154f1897cffc4f
I20260812 16:46:40.889569 319 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: loading cluster ID for follower catalog manager: success
I20260812 16:46:40.890684 319 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: acquiring CA information for follower catalog manager: success
W20260812 16:46:40.890873 319 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260812 16:46:40.897024 32750 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8daf9a3c1b04f13bc6b1a662d6f2219" member_type: VOTER last_known_addr { host: "127.21.114.126" port: 32979 } } peers { permanent_uuid: "74d0898ad0454b4491203766d12ff1d4" member_type: VOTER last_known_addr { host: "127.21.114.125" port: 39247 } } peers { permanent_uuid: "2361920df1d24b53b8730b20f910e095" member_type: VOTER last_known_addr { host: "127.21.114.124" port: 42109 } } }
I20260812 16:46:40.897126 32750 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219 [sys.catalog]: This master's current role is: LEADER
I20260812 16:46:40.898881 32752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8daf9a3c1b04f13bc6b1a662d6f2219: Generated new TSK 0
I20260812 16:46:40.899065 32752 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 16:46:40.929430 32403 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.927937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.21.114.126:32979)
0812 16:46:40.927985 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.927987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.928740 (+ 753us) server_negotiation.cc:407] Connection header received
0812 16:46:40.928849 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.928851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.928863 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.928895 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.929340 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41498: BlockingRecv error: recv got EOF from 127.0.0.1:41498 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 16:46:40.930202 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.928283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35746 (local address 127.21.114.125:39247)
0812 16:46:40.928349 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.928351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.929675 (+ 1324us) server_negotiation.cc:407] Connection header received
0812 16:46:40.929772 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.929773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.929784 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.929817 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.930140 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35746: BlockingRecv error: recv got EOF from 127.0.0.1:35746 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 16:46:40.930974 32696 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.928657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.21.114.124:42109)
0812 16:46:40.928704 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.928706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.930439 (+ 1733us) server_negotiation.cc:407] Connection header received
0812 16:46:40.930544 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.930545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.930556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.930587 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.930912 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52688: BlockingRecv error: recv got EOF from 127.0.0.1:52688 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 16:46:40.933321 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.932540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35750 (local address 127.21.114.125:39247)
0812 16:46:40.932578 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.932580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.932802 (+ 222us) server_negotiation.cc:407] Connection header received
0812 16:46:40.932909 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.932910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.932930 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.932961 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.933270 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35750: BlockingRecv error: recv got EOF from 127.0.0.1:35750 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 16:46:40.936290 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.935549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35766 (local address 127.21.114.125:39247)
0812 16:46:40.935581 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.935583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.935782 (+ 199us) server_negotiation.cc:407] Connection header received
0812 16:46:40.935882 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.935883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.935892 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.935925 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.936245 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35766: BlockingRecv error: recv got EOF from 127.0.0.1:35766 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 16:46:40.940124 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.939448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35776 (local address 127.21.114.125:39247)
0812 16:46:40.939480 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.939482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.939671 (+ 189us) server_negotiation.cc:407] Connection header received
0812 16:46:40.939760 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.939761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.939770 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.939797 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.940082 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35776: BlockingRecv error: recv got EOF from 127.0.0.1:35776 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 16:46:40.945942 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.945246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35786 (local address 127.21.114.125:39247)
0812 16:46:40.945278 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.945280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.945484 (+ 204us) server_negotiation.cc:407] Connection header received
0812 16:46:40.945575 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.945576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.945585 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.945613 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.945900 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35786: BlockingRecv error: recv got EOF from 127.0.0.1:35786 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 16:46:40.955919 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.955122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35798 (local address 127.21.114.125:39247)
0812 16:46:40.955160 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.955162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.955379 (+ 217us) server_negotiation.cc:407] Connection header received
0812 16:46:40.955490 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.955491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.955503 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.955532 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.955858 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35798: BlockingRecv error: recv got EOF from 127.0.0.1:35798 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 16:46:40.974260 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:40.973323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35806 (local address 127.21.114.125:39247)
0812 16:46:40.973366 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:40.973369 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:40.973640 (+ 271us) server_negotiation.cc:407] Connection header received
0812 16:46:40.973756 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:40.973757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:40.973770 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:40.973803 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:40.974202 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35806: BlockingRecv error: recv got EOF from 127.0.0.1:35806 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 16:46:41.008798 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:41.007737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.21.114.125:39247)
0812 16:46:41.007784 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.007787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.008054 (+ 267us) server_negotiation.cc:407] Connection header received
0812 16:46:41.008171 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.008173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.008188 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.008223 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:41.008722 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35810: BlockingRecv error: recv got EOF from 127.0.0.1:35810 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 16:46:41.075214 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:41.074399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35814 (local address 127.21.114.125:39247)
0812 16:46:41.074483 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.074485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.074602 (+ 117us) server_negotiation.cc:407] Connection header received
0812 16:46:41.074661 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.074662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.074673 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.074714 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:41.075141 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35814: BlockingRecv error: recv got EOF from 127.0.0.1:35814 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 16:46:41.205358 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:41.204576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35820 (local address 127.21.114.125:39247)
0812 16:46:41.204649 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.204651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.204729 (+ 78us) server_negotiation.cc:407] Connection header received
0812 16:46:41.204813 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.204814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.204825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.204881 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:41.205268 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35820: BlockingRecv error: recv got EOF from 127.0.0.1:35820 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 16:46:41.463289 32556 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 16:46:41.462675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35828 (local address 127.21.114.125:39247)
0812 16:46:41.462752 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.462753 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.462763 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:46:41.462790 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.462791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.462802 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.462856 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 16:46:41.463231 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35828: BlockingRecv error: recv got EOF from 127.0.0.1:35828 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 16:46:41.834522 32743 catalog_manager.cc:1259] Loaded cluster ID: 6f6f58b82cb44da4b2154f1897cffc4f
I20260812 16:46:41.834611 32743 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: loading cluster ID for follower catalog manager: success
I20260812 16:46:41.835572 32743 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: acquiring CA information for follower catalog manager: success
I20260812 16:46:41.835944 32743 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2361920df1d24b53b8730b20f910e095: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:46:41.891548 319 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 74d0898ad0454b4491203766d12ff1d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 16:46:41.979449 477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:41.976601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35844 (local address 127.21.114.125:39247)
0812 16:46:41.976735 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.976737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.976835 (+ 98us) server_negotiation.cc:407] Connection header received
0812 16:46:41.976930 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.976932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.976998 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.977089 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:41.977318 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.977822 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.978599 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.978810 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.978886 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:41.979076 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:41.979194 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:41.979294 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:41.979312 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 16:46:41.979335 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260812 16:46:41.984035 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:41.981434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52690 (local address 127.21.114.124:42109)
0812 16:46:41.981542 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.981544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.981605 (+ 61us) server_negotiation.cc:407] Connection header received
0812 16:46:41.981659 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.981660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.981693 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.981776 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:41.981872 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.982432 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.983271 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.983516 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.983580 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:41.983709 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:41.983804 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:41.983866 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:41.983898 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 16:46:41.983916 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":52,"threads_started":1}
I20260812 16:46:41.988837 501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:41.985795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41514 (local address 127.21.114.126:32979)
0812 16:46:41.985912 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.985928 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.985938 (+ 10us) server_negotiation.cc:407] Connection header received
0812 16:46:41.985983 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.985984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.986034 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.986132 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:41.986327 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.986960 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.987855 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.988166 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.988262 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:41.988468 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:41.988577 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:41.988645 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:41.988720 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 16:46:41.988747 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":72,"threads_started":1}
I20260812 16:46:41.989087 477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:41.985964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35860 (local address 127.21.114.125:39247)
0812 16:46:41.986004 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.986006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.986131 (+ 125us) server_negotiation.cc:407] Connection header received
0812 16:46:41.986235 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.986236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.986249 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.986280 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:41.986508 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.987253 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.988213 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.988509 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.988569 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:41.988801 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:41.988831 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:41.988859 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:41.988977 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 16:46:41.989000 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 16:46:41.989214 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 16:46:41.986254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52698 (local address 127.21.114.124:42109)
0812 16:46:41.986288 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 16:46:41.986290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 16:46:41.986435 (+ 145us) server_negotiation.cc:407] Connection header received
0812 16:46:41.986468 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 16:46:41.986469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 16:46:41.986480 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 16:46:41.986538 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 16:46:41.986654 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.987344 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.988190 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 16:46:41.988498 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 16:46:41.988569 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 16:46:41.988733 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 16:46:41.988765 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 16:46:41.988799 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0812 16:46:41.988904 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 16:46:41.989134 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 16:46:41.990871 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32249
I20260812 16:46:42.007167 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32407
I20260812 16:46:42.021365 21961 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskP_fNe3/build/release/bin/kudu with pid 32562
2026-08-12T16:46:42Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3165 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6347 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (285419 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST